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Abstract 

We  analyze  a  sequence  of  single-server  queueing  systems  with  impatient  customers  in  heavy 
traffic.  Our  state  process  is  the  offered  waiting  time  and  the  customer  arrival  process  has  a 
state  dependent  intensity.  Service  times  and  customer  patient-times  are  independent,  i.i.d.  with 
general  distributions  subject  to  mild  constraints.  We  establish  the  heavy  traffic  approximation 
for  the  scaled  offered  waiting  time  process  and  obtain  a  diffusion  process  as  the  heavy  traffic 
limit.  The  drift  coefficient  of  this  limiting  diffusion  is  influenced  by  the  sequence  of  patience¬ 
time  distribution  in  a  non-linear  fashion.  We  also  establish  an  asymptotic  relationship  between 
the  scaled  version  of  offered  waiting  time  and  queue-length.  As  a  consequence,  we  obtain  the 
heavy  traffic  limit  of  the  scaled  queue-length.  We  introduce  an  infinite-horizon  discounted  cost 
functional  whose  running  cost  depends  on  the  offered  waiting  time  and  server  idle  time  processes. 

Under  mild  assumptions,  we  show  that  the  expected  value  of  this  cost  functional  for  the  n-th 
system  converges  to  that  of  the  limiting  diffusion  process  as  n  tends  to  infinity. 

Keywords:  Stochastic  control,  Controlled  queueing  systems,  Heavy  traffic  theory,  Diffusion  approx¬ 
imations,  Customer  abandonment,  Customer  impatience,  Reneging. 

AMS  Subject  Classifications:  primary  60K25,  68M20,  90B22;  secondary  90B18. 


1  Introduction 

In  this  article,  we  study  a  heavy  traffic  approximation  result  for  a  sequence  of  single-server  queue¬ 
ing  systems  with  impatient  customers.  Customers  are  served  under  First-Come-First-Serve  (FCFS) 
service  discipline.  This  sequence  of  queueing  systems  with  a  similar  dynamic  structure  is  parame¬ 
terized  by  n  =  1,2,3,...  and  is  in  heavy  traffic  in  a  sense  that  will  be  made  precise  in  Section 
3.  The  arrival  process  of  the  n-th  system  has  a  dynamic  intensity  which  depends  on  the  offered 
waiting  time  and  this  intensity  is  of  order  0(n)  for  large  n.  The  service  times  are  i.i.d.  with  general 
distributions  and  for  the  n-th  system,  mean  service  time  is  of  order  0(l/n),  and  thus  creating  heavy 
traffic.  The  customers  abandon  the  system  if  the  service  is  not  initiated  within  their  patience-time. 
They  act  independently  and  in  the  n-th  system,  their  patience-times  are  i.i.d.  distributed  and  this 
distribution  may  depend  on  n. 

’Research  supported  by  U.  S.  Army  Research  Office  grant  W911NF0710424. 
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In  many  real  world  examples,  such  as  telephone  call  centers  or  internet  traffic,  customers  may 
not  observe  the  actual  queue-length  but  often  approximate  waiting  time  is  available  to  them.  In 
our  model,  offered  waiting  time  (or  the  workload  process)  is  the  basic  state  process  and  the  arrival 
intensity  of  the  customers  is  dependent  on  it.  To  motivate  this  work,  consider  a  processing  facility 
where  each  customer  or  job  arrives  with  a  deadline.  Upon  the  arrival  of  each  customer,  a  system 
manager  learns  about  the  customer  deadline  as  well  as  the  required  service  time.  Hence,  the 
information  on  offered  waiting  time  is  available  to  the  manager  and  accordingly,  the  manager  can 
influence  the  arrival  intensity  by  means  of  admission  control.  In  practice,  customer  abandonment 
is  a  well  documented  significant  feature  of  the  queueing  systems.  In  the  queueing  models,  Palm 
[23]  initiated  the  importance  of  incorporating  this  feature.  In  the  telephone  call  center  setting  with 
many-server  systems,  such  models  are  considered  in  [14,  19,  11,  12,  36,  29,  22,  25].  For  single  server 
setting,  Ward  and  co-authors  addressed  several  performance  evaluation  issues  of  such  systems  in 
[30,  31,  26].  For  general  queueing  systems  in  heavy  traffic  (with  or  without  customer  abandonment), 
there  are  numerous  articles  that  address  the  issue  of  system  optimization  and  [3,  5,  15,  16]  is  a 
partial  list  of  such  articles. 

The  results  established  in  this  article  are  closely  related  to  the  works  of  [26]  and  [30,  31],  but 
they  differ  in  three  main  aspects:  First,  in  the  n-th  system,  the  intensity  of  our  arrival  process  is 
non-constant  and  may  depend  on  the  current  value  of  the  offered  waiting  time.  Loosely  speaking, 
system  manager  may  exercise  adjustments  of  order  0{y/n)  to  the  admission  rate  of  the  n-th  system 
without  disturbing  the  delicate  balance  in  heavy  traffic  conditions.  But  such  adjustments  have 
an  influence  on  the  drift  coefficient  of  the  limiting  diffusion  process  as  described  in  our  Theorem 
4.8.  In  controlled  queueing  systems,  such  adjustments  are  known  as  “thin  control”  and  we  refer  to 
[1,  16]  for  such  problems.  Second,  our  assumptions  on  patience-tinre  distribution  are  quite  general. 
In  Markovian  abandonment  regimes  [30]  and  also  in  [31]  (for  many-server  queues  in  Halfin- Whitt 
heavy  traffic  regime  see  [4,  12,  11,  21,  14,  22,  25])  where  the  same  patience-tinre  distribution  is  used 
in  the  modeling,  only  the  behavior  of  patience-tinre  distribution  in  a  neighborhood  of  origin  effects 
the  dynamics  of  the  limiting  diffusion.  But,  in  an  interesting  article  [26],  Reed  and  Ward  consider 
the  patient  time  distribution  of  the  n-th  system  to  have  a  hazard  rate  intensity  dependent  on  n  (see 
[25]  for  a  nrany-server  Halfin- Whitt  heavy  traffic  case).  They  provide  statistical  data  in  support 
of  their  choice.  The  dynamics  of  their  limiting  diffusion  process  depends  on  the  entire  patience- 
tinre  distribution  function.  Our  results  incorporates  both  of  these  scenarios  in  the  same  general 
framework  as  illustrated  in  the  examples  of  Section  3.  Our  assumptions  can  be  satisfied  by  many 
other  classes  of  patience-tinre  distribution  functions,  and  Theorem  4.8  describes  the  effect  of  these 
distribution  functions  on  the  limiting  diffusion.  One  key  ingredient  in  our  proof  of  Theorem  4.8  is 
the  martingale  functional  central  limit  theorem,  and  this  approach  helps  us  to  accommodate  these 
general  assumptions.  This  is  in  contrast  with  the  proofs  in  [26].  Third,  we  employ  Theorem  4.8 
to  establish  the  convergence  of  the  expected  value  of  an  infinite  horizon  discounted  cost  functional 
of  the  n-th  system  to  that  of  the  limiting  diffusion  process  as  n  — >  oo.  Such  convergence  results 
for  the  expected  value  of  the  cost  functionals  are  important  in  deriving  asymptotically  optimal 
strategies  for  the  system  optimization  problems  in  heavy  traffic  regime.  We  refer  to  [32,  16]  (and 
[5,  4,  22]  in  many-server  Halfin- Whitt  heavy  traffic  regime)  for  such  results  related  to  controlled 
queueing  systems.  We  intend  to  use  the  results  obtained  here  to  address  such  a  controlled  system 
optimization  problem  in  a  future  article. 

This  article  is  organized  as  follows.  In  Section  2  we  introduce  the  basic  model.  We  give  details 
about  the  construction  of  the  arrival  process  with  an  intensity  dependent  on  offered  waiting  time, 
and  introduce  the  key  martingale  relevant  to  the  arrival  process.  Such  a  martingale  formulation  is 
used  in  [35]  for  the  heavy  traffic  analysis  of  queue  length  processes,  when  the  arrival  and  service 
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rates  are  dependent  on  queue  length.  In  Section  3,  we  speed  up  the  arrival  rates  to  be  of  order 
0{n)  and  to  balance  this  and  to  obtain  heavy  traffic  conditions,  we  make  the  average  service  time 
in  the  ra-th  system  to  be  K  We  carefully  lay  out  our  assumptions  on  arrival  intensities,  service 
times  and  patience-tinre  distributions.  Section  4  addresses  the  weak  convergence  of  scaled  offered 
waiting  time  processes  in  heavy  traffic.  We  establish  the  fluid  limit  first  and  then  use  it  to  obtain 
the  diffusion  limit  for  the  scaled  offered  waiting  time  process.  Main  result  in  this  section  is  Theorem 
4.8,  and  we  use  martingale  functional  central  limit  theorem  to  obtain  this  weak  convergence  result. 
In  Section  5,  we  establish  the  asymptotic  relationship  between  the  scaled  queue  length  and  scaled 
offered  waiting  time  processes.  Here  we  follow  the  proof  of  a  similar  result  in  [26],  but  supplement 
it  with  necessary  additional  estimates  to  accommodate  our  general  assumptions.  We  address  the 
issue  of  convergence  of  the  expected  value  of  infinite  horizon  discounted  cost  functional  of  the  n-th 
system  to  that  of  the  limiting  diffusion  under  heavy  traffic  in  Section  6.  In  this  cost  functional, 
the  running  cost  function  depends  on  offered  waiting  time  and  server  idle  time.  Since  the  running 
cost  function  is  unbounded  and  is  of  polynomial  growth,  we  need  a  few  additional  assumptions 
there.  To  reach  our  conclusion,  we  establish  necessary  moment  estimates  and  combine  them  with 
the  weak  convergence  result  in  Theorem  4.8.  For  controlled  queueing  networks,  such  convergence 
results  are  obtained  in  [32,  16]  and  in  the  case  of  many-server  systems,  we  refer  to  [5]. 

The  following  notation  is  used.  The  set  of  positive  integers  is  denoted  by  IN,  the  set  of  real 
numbers  by  JR  and  nonnegative  real  numbers  by  1??+.  Let  JRd  be  the  d-dimensional  Euclidean 
space  and  for  x  £  lRd  the  L\  norm  of  x,  i.e.,  Yli= i  lx*l>  will  be  denoted  by  |x|.  For  a,b  £  JR,  let 
a  A  b  =  min{a,  6}  and  a+  =  max{a,  0},  a~  =  —  min{a,  0}.  We  use  [a]  to  denote  the  integer  part  of 
a  £  JR.  The  convergence  in  distribution  of  random  variables  (with  values  in  some  Polish  space)  4>n  to 
will  be  denoted  as  4>n  4>.  With  an  abuse  of  notation  weak  convergence  of  probability  measures 

(on  some  Polish  space)  /j,n  to  [i  will  also  be  denoted  as  \in  fi.  When  sup  |/n(s)  —  f(-s)\  — >  0  as 

o  <s<t 

n  — >  oo,  for  all  t  >  0,  we  say  that  fn  — >  /  uniformly  on  compact  sets.  For  a  real  valued  function 
/  defined  on  some  metric  space  X  and  T  £  JR+,  define  ||/||t  =  sup  |/(x)|.  Finally,  let  D[0,oo) 

x£[0,T] 

denote  the  class  of  right  continuous  functions  with  having  left  limit  defined  from  [0,  oo)  to  JR, 
equipped  with  the  usual  Skorokhod  topology. 


2  Basic  Model 

First  we  describe  the  queueing  model  with  FCFS  service  discipline  and  customer  abandonment 
on  a  probability  space  (Q,JF,JP).  Let  A(t)  be  the  number  of  customers  arrived  at  the  station  by 
time  t.  The  random  variable  tj  represents  the  arrival  time  of  the  j-th  customer,  and  we  assume 
JE(tj)  <  oo.  Service  time  of  the  j-th  customer  is  represented  by  the  random  variable  Vj.  We  assume 
that  the  customers  are  impatient  and  the  j-th  customer  may  leave  the  system  at  a  random  time 
dj  if  the  service  is  not  completed  by  then.  The  sequences  ( Vj )  and  ( dj )  are  assumed  to  be  i.i.d. 
and  independent  of  each  other,  JE{v\ )  =  1  and  var(tq)  =  of  <  oo.  We  let  F  be  the  cumulative 
distribution  function  of  d\. 

The  amount  of  time  an  incoming  customer  at  time  t  has  to  wait  for  service  depends  upon  the 
service  times  of  the  non-abandoning  customers,  who  are  already  waiting  in  the  queue.  Similar  to 
[26],  we  define  the  offered  waiting  time  process 

Ait) 

V(t)  =  Y,vi1[vitj-)<dj]  ~ 
f=i 


l[V'(s)>0]  (s)rfs. 


(2.1) 
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Figure  1:  A  typical  sample  path  ofV(t). 


The  process  {V(t)  :  t  >  0}  is  non-negative,  has  sample  paths  which  are  right  continuous  with  left 
limits  and  also  it  has  upward  jumps  at  the  arrival  epochs  (tj).  On  the  time  interval  [tj,tj+ 1),  V(t) 
is  continuous,  non-increasing  and  satisfies  V(t)  =  nrax{0,  V (tj)  —  (t  —  tj)}.  The  picture  depicted  in 
Figure  1  shows  a  typical  sample  path  of  the  process  {V (i)}t>o-  The  quantity  V (t)  can  be  interpreted 
as  the  time  needed  to  empty  the  system  from  time  t  onwards  if  there  are  no  arrivals  after  time  t, 
and  hence  it  is  also  known  as  the  workload  at  time  t.  We  note  that  once  V(tn)  is  known  then  V(t) 
is  well  defined  on  the  next  interval  [tn,tn- |_i)  (see  below  (2.9)  for  more  details). 

Next,  we  define  the  u-fields  (Fn)n> i  where 

n  —  V\,  dl),  .  .  .  ,  (trn  Vm  dii) ,  tn+ 1)  U  tF .  (2.2) 

Notice  that  V (tn—)  is  JF^-i-measurable  and  the  abandonment  time  dn  of  the  n-th  customer  is 
independent  of  Fn-\.  Hence, 

P[V(tn~)  >  dn|^n_i]  =  F(V(tn-))  (2.3) 

holds,  where  F  is  the  distribution  function  of  dn.  We  introduce  two  martingales  ( Mv{n ))  and 
(. Md(n ))  with  respect  to  the  filtration  (Fn)n>i  introduced  in  (2.2).  We  let 

n 

M»  =  2(ui-l  (2-4) 

3= 1 
n 

Md(n)  =  ^2  (l[^(*j-)>rfj]  -  iK[l[nb-)><idl^'-i]) 

3=1 

for  all  n  G  M.  Clearly,  Md(n)  is  an  ^-martingale  (see  also  [26]).  Here  we  show  that  Mv(n)  also  is 
an  ^-martingale.  Since  V{tn+\— )  and  dn+\  are  measurable  with  respect  to  a(Fn,  dn+i)  and  vn+\ 
is  independent  of  a(Fn,dn+i),  it  follows  that 

dE  (vn+l  —  l)l[y(tn+1-)<d„+1] \&{Fn,  dn+\)  =  l[y(tn+1-)<dn+1]iF(un+i  —  1)  =  0. 

Now  conditioning  both  sides  of  (2.4)  with  respect  to  Fn.  we  can  see  that  Mv(n)  is  an  ^-martingale 
as  well.  Using  (2.3)  in  (2.5),  we  also  see  that  for  all  n  G  W 

n 

Md(n)  =  J2  [V(t, -)><*,]  -  •  (2-6) 

3=1 
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Using  (2.1),  (2.3)— (2.6)  and  after  simple  algebraic  manipulations,  we  obtain  the  following  system 
equation:  for  all  t  >  0, 

V(t)  +  f  F{V{s—))dA{s)  =  (. A(t )  -t)  +  Mv(A(t))  -  Md(A(t ))  +  I(t),  (2.7) 

Jo 

where 

I(t)=  [  l[y(s)=o ](s)ds,  (2.8) 

Jo 

and  I {t)  represents  the  idle  time  at  the  station  during  time  interval  [0,  t]. 

To  describe  the  arrival  process  A(-)  with  arrival  times  (tj),  let  A(-)  be  a  given  Borel  measurable 
function  defined  on  [0,  oo)  which  satisfies  the  condition  0  <  e  <  X(x)  <  C  for  all  x  >  0.  Here  e  and 
C  are  positive  constants.  In  our  analysis,  we  assume  that 

jn(f)  -  A (V(s))ds  :  t  >  0  j  (2.9) 

is  a  martingale  with  respect  to  the  filtration  (Gt)t>  o>  where  Gt  =  <j(H(s),  V(s)  :  s  <t).  Notice  that 
once  the  value  of  V (tn)  is  known,  the  process  V (t)  can  be  obtained  on  [tn,  t,n+  \ )  as  explained  earlier. 
Hence,  the  quantity  X(V(s))ds  is  also  known  for  all  tn  <  t  <  tn+  \ . 

Following  several  results  in  [8],  here  we  indicate  the  construction  of  such  a  process  H(-)  and 
several  of  its  properties.  We  begin  with  a  probability  space  (H,  J7,  IPq).  Assume  that  (uj)  and  (d*) 
are  independent  sequences  of  positive  i.i.d.  random  variables  in  this  space.  Recall  that  Vi  has 
mean  1  and  variance  a2  while  dt  has  distribution  function  F.  We  introduce  the  u-algebra  Go  by 
Go  =  cr ((vi,di)  :  i  =  1,2,...).  Next,  we  let  A(-)  be  a  standard  (unit  intensity)  Poisson  process 
which  is  independent  of  Go,  and  ( ti )  are  the  jump  times  of  A(-).  Using  this  Poisson  process  A(-), 
the  sequences  (vi)  and  (dj),  we  can  introduce  the  offered  waiting  time  process  U(-)  as  in  (2.1).  We 
introduce  two  filtrations  (Gt)  and  (G)t  by 

Gt  =  cr(^4(s),  U(s)  :  0  <  s  <  t)  and  Gt  =  Gt^Qo,  (2.10) 

that  is,  Gt  is  the  u-algebra  generated  by  the  sets  in  Gt  U  Go-  Next,  we  introduce  the  left-continuous 
version  V(-)  of  the  offered  waiting  time  process  by 


V(t) 


V(t),  if  t^ti, 
V(U- ),  if  t  =  ti . 


(2.11) 


Thus  U(-)  is  (^t)-adapted  left-continuous  process  with  left  limits.  Consequently,  V(-)  is  a  predictable 
process  with  respect  to  each  of  the  filtrations  (Gt)  and  (Gt)  (see  Section  3  of  Chapter  1  in  [8]).  Next, 
we  intend  to  apply  change  of  intensities  for  point  processes  (cf.  Section  2  of  Chapter  6,  [8]).  We 
introduce  the  process  L(-)  by 

(1  —  A (V(s)))ds^j  ,  if  t  <  ti, 

(1  —  A(U(s)))ds  +  J  log(X(V(s)))dA(s))  ,  if  t>t\. 

Since  A(-)  is  Borel  measurable  and  0  <  e  <  X(x)  <  C  for  all  x  >  0,  we  can  use  theorems  T2,  T3 
and  T4  in  pages  165-168  of  [8]  to  verify  that  L(-)  is  a  (^-martingale  and  !E[L(t)\  =  1  for  each 
t  >  0.  Since  L(-)  is  adapted  to  (Gt)t> o>  it  is  also  a  (^)-martingale. 
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Let  T  >  0  be  fixed  and  introduce  the  probability  measure  IPt  on  Qt  by 


cUPt 
dlP< o 


L(T). 


(2.12) 


Then  by  Theorem  T3  in  Chapter  6  of  [8],  the  process  A(-)  has  (IPt,  <5* ) -intensity  A (V(t))  for 
0  <  t  <  T.  Using  Theorem  T9  in  page  28  of  [8]  and  by  a  straightforward  computation,  it  follows 
that  {A(t)  -  f*A(V(s))ds  :  0  <  t  <  T}  is  a  ( Qt)o<t<T  -martingale  with  respect  to  IPt ■  Since 
{A(t)  —  fgA(V(s))ds  :  0  <  t  <  T}  is  adapted  to  ( Qt)o<t<T ,  it  is  also  a  (fn)o<t<T-martingale  with 
respect  to  IPt ■  It  is  evident  that  the  probability  measures  (Pt)t> o  are  consistent  and  thus  there 
is  a  probability  measure  IP  on  Q ^  so  that  IPt  and  IP  agree  on  Qt- 

Since  each  IPt  and  IPq  agree  on  Qq,  it  follows  that  (vt)  and  (4)  are  independent  sequences  of 
i.i.d.  random  variables  with  desired  distribution  with  respect  to  IP.  Also  since  V(t)  =  V(t)  except 
on  a  set  of  Lebesgue  measure  zero,  it  follows  that  A(V ( s))ds  =  fg  A(V (s))ds  for  all  f  >  0.  Hence, 
we  conclude  that  with  respect  to  probability  IP, 


and  as  a  consequence, 


A(t)  —  /  A (V(s))ds  :  t  >  0  {  is  a  (^)-martingale, 

Jo 


A(t)  —  j  A  (V(s))ds  :  t  >  o|  is  also  a  (1/^)- mart  ingale. 


(2.13) 


(2.14) 


The  martingale  property  of  this  process  with  respect  to  (Qt)  filtration  will  be  used  only  in  the  proof 
of  Proposition  4.10.  This  completes  the  construction  of  the  arrival  process  A(-). 

We  note  that  since  A(-)  is  a  point  process  with  (^-intensity  A (V(t)),  we  can  use  the  random 
change  of  time  method  (see  Theorem  T16  and  Lemma  L17  in  Section  6  of  Chapter  2,  [8])  to  obtain 
the  convenient  representation 

A(t)  =  Y  A (V(s))ds^j  =  Y  A (V(s))ds^j  ,  (2.15) 

where  Y(-)  is  a  standard  Poisson  process.  This  representation  helps  us  in  several  estimates. 


3  Heavy  Traffic  Regime 

We  consider  a  sequence  of  queueing  systems  indexed  by  n  6  IV.  In  our  analysis,  basic  state  process 
of  the  n-th  system  will  be  the  offered  waiting  times  process  Vn(-).  The  arrival  rate  nAn(Vn(-))  of 
the  n-th  system  is  state  dependent  and  the  j-th  customer  arrival  occurs  at  time  P- .  The  cumulative 
number  of  customer  arrivals  in  [0,  t]  in  the  system  is  given  by  An(t).  When  n  becomes  large,  arrival 
rate  of  the  n-th  system  becomes  large  and  thus  to  obtain  heavy  traffic  conditions,  we  need  to  make 
the  service  time  of  the  n-th  system  small  as  described  below. 

For  the  j-th  arrival  in  the  n-th  system,  service  time  is  vj  =  Vj/n,  and  the  abandonment  time 
is  denoted  by  d”.  As  described  in  [26],  the  basic  equation  of  the  offered  waiting  time  process 
{14 (t)  :  t  >  0}  is  given  by 

^  Ad4) 

Vn(t)  =  -  v31[Vn(t'?-)<d'?]  -  /  ![V„(s)>0](«)^i  (3-1) 

n  “T  do 
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where  Anf)  is  the  arrival  process.  We  introduce  the  filtration  {Gf  :  t  >  0}  of  the  n-th  system  by 
Gf  =  a(An(s),Vn(s)  :  s  <t).  We  also  introduce  the  filtration  (Q™)  as  similar  to  (2.10).  Next,  we 
define  the  discrete  time  filtration  1  by 


(3.2) 


for  i  >  1  and  let  T(f  =  cr(i”).  Next,  we  define  the  associated  continuous  time  filtration  {iFf)t>o  by 
F?  -  «5N  d?),  •  •  • ,  (tfnt],  v?nt]^nt]),  ifo+1).  (3.3) 


Now  we  describe  our  basic  assumptions: 

Assumption  3.1. 


(%)  The  sequences  i  and  (dj)j> l  are  non-negative  valued,  i.i.d.  random  variables  with 

v ^  /or  all  j  >  1,  IE(vj)  =  1  and  lE(vj  —  l)2  =  u2  >  0.  Furthermore,  n”+1  is  independent 
of  and  the  sequence  (d”)j>i  is  independent  of  the  sequence  (t”,u”)j>i. 

/ii)  TTie  arrival  process  An{-)  of  the  n-th  system  has  an  associated  intensity  process  n\n(Vn(-)); 
that  is, 

An(t )  -  n  J  Xn(Vn(s))ds  :  t  >  o|  (3.4) 

is  a  (Qf) -martingale  and  (Gf) -martingale  as  well. 

Assumption  3.2. 

(%)  The  function  An(-)  is  Borel  measurable  on  [0,oo)  and  f/iere  exist  two  positive  constants 
€0,6*0  >  0  (independent  of  n  and  x)  such  that  0  <  eo  <  Xn(x)  <  Co  for  all  x  >  0  and 
n>  1. 

(%%)  For  each  K  >  0,  lim  sup  |An(.x)  —  1 1  =  0. 

,wooa;e[0,A'] 

(Hi)  There  exist  small  do  >  0  and  M  >  0  such  that  sup  sup  y/n( Xn(x)  —  1)+  <  M  <  oo. 

n>  1  ze[0,50] 

(iv)  There  exists  a  non-negative  continuously  differentiable  function  u(-)  defined  on  [0,oo)  such 
that  for  each  K  >  0, 

lim  sup 

n^°°  x&[Q,K\ 


Vny  1  -  An  -  u{x) 


=  0. 


Assumption  3.3.  Let  Fnf)  be  the  right  continuous  abandonment  distribution  function  of  the  i.i.d. 
sequence  (dj)j> i-  Assume  that  Fn( 0)  =  0  and  there  is  a  non-negative  continuously  differentiable 
function  Hf)  such  that  for  each  K  >  0, 


lim 

n— >  oo 

As  a  consequence,  we  have  H( 0)  = 


sup 

a;£[0,/\] 


v^pn  4=  - 


0  and  lim  Fn(x/y/n) 


H(x) 


=  0. 


=  0  for  each  x  >  0. 
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Remark  3.4.  We  provide  concrete  examples  that  satisfy  the  above  set  of  assumptions. 


1.  An  example  of  arrival  rate  function  An(-):  Take 


^  i  u(y/nx)  9n(x) 

An(x)  =  1 - 7= - 1 - 

vn  vn 

where  9n(-)  is  a  bounded  function  such  that  lim  1 1 On \ \  k  =  0  for  each  K  >  0. 

n— >oo 

2.  Examples  of  abandonment  distribution  functions  (Fn)  : 


(a)  Let  Fn  =  F  for  all  n,  and  F  be  differentiable  with  a  bounded  derivative  on  [0,  <5]  for  some 
8  >  0.  Hence ,  H(x)  =  F'(0)x  in  Assumption  3.3. 

(b)  We  may  take  Fn(x)  =  1  —  exp(—  fQl  h(y/nu)du)  for  x  >  0,  where  h  is  a  non-negative 
continuous  function  as  in  (If)  of  [26].  In  this  case,  H(x)  =  fg  h(u)du  and  it  satisfies 
Assumption  3.3  since  h  is  continuous.  Indeed,  for  any  general  sequence  (Fn),  if  F'n{-^F) 
converges  to  a  non-negative  function  h(x)  uniformly  on  compact  sets,  then  (Fn)  satisfies 
Assumption  3.3  with  the  limiting  function  H(x)  =  f([  h(u)du. 

(c)  Here  we  provide  a  simple  example  to  illustrate  that  there  can  be  many  limiting  func¬ 
tions  H(-)  other  than  the  ones  described  in  (a)  and  (b)  above.  Let  H(-)  be  any  non¬ 
negative,  non- decreasing,  continuously  differentiable  function  which  satisfies  H( 0)  =  0 
and  H{+ oo)  =  +oo.  We  let  Fn{x)  =  imn{H (y/nx) ,  y/n}  for  all  x  >  0.  Then,  for 
each  n  >  1,  Fn( 0)  =  0,Fra(+oo)  =  1  and  Fn  is  a  continuous,  non- decreasing  probability 
distribution  function.  It  is  evident  that  the  sequence  of  distribution  functions  Fn  satisfies 
the  Assumption  3.3  with  limiting  function  Hf). 

Remark  3.5.  To  describe  a  specific  example  of  a  heavy  traffic  regime  using  the  same  arrival 
process,  we  can  consider  the  system  (A(-),V(-))  satisfying  (2.1),  (2.7)-(2.9).  Then  we  can  scale 
these  processes  as  described  next.  First,  we  introduce  the  filtration  (Gf)  by  G?  =  Gnt  for  each 
n  >  1,  where  Gt  =  cr(A(s),  V(s)  :  0  <  s  <  t).  Now  let  An(t)  =  A(nt)  and  Vn(t)  =  V(nt) 
for  all  t  >  0.  Then  using  (2.9)  and  by  a  change  of  variable  in  integration,  it  easily  follows  that 
{An{f)  —  n  fg  An(Vn(s))ds  :  t  >  0}  is  a  (Gf) -martingale. 

Throughout,  one  can  consider  the  arrival  intensity  An(-)  as  a  “control  process”  related  to  the  n-th 
system.  In  a  future  article,  we  intend  to  address  an  optimal  control  problem  associated  with  this 
heavy  traffic  regime,  which  minimizes  a  prescribed  cost  functional.  We  refer  to  [2,  3,  16]  for  related 
“thin  control”  problems  and  also  refer  to  Chapter  VII  of  [8]. 

It  will  be  helpful  to  define  fluid-scaled  and  diffusion-scaled  quantities  to  carry  out  our  analysis. 
We  let 

An{t)  =  and  An(t)  =  -^=  ( An(t)  -  n  f  Xn(Vn(s))ds\  (3.5) 

n  V™  \  Jo  ) 

for  all  t  >  0.  We  also  introduce  the  diffusion-scaled  offered  waiting  time  process 

Vn{f)  =  y/nVn(t)  for  all  t  >  0.  (3.6) 


We  then  have  diffusion-scaled  martingales  with  respect  to  the  filtration  (Ff)  (see  (3.3)),  given  by 

=  —/ =  YX*  ~  1)1[Vn(t^-)<dfi,  M%(t) 

V 16  .  .  J  J 

3= 1 
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Using  (3.1),  (3.4)  and  the  state  equation  described  in  (2.7),  and  after  simple  algebraic  manipula¬ 
tions,  we  obtain 

Vn(t)  +  -  [  Fn(Vn(s-))dAn(s)  =  —  ( An(t)  —  n  f  X ,n(Vn(s))ds\ 

n  Jo  n  V  Jo  / 

+  -)=  (M”(A.(t))  -  Mi(An(t))) 

+  f  [\n(Vn(s))  —  l\ds  +  In(t) ,  (3.8) 

Jo 

where  In(t)  =  1  [Vn(s)=o]ds  for  all  t  >  0. 


4  Weak  Convergence 

4.1  Fluid  limits 

Throughout  we  use  ||  •  ||t  defined  by  ||/||t  =  sup  |/(s)|  for  any  /  in  D[0,oo).  Our  aim  here  is 

[0,T] 

first  to  establish  the  fluid  limit  lim  ||Ui||t  =  0  in  probability  for  each  T  >  0.  We  intend  to  employ 

71— XX) 

several  properties  of  the  Skorokhod  map  T  (see,  for  example,  [20,  9,  33,  17])  in  the  discussion  below. 
The  Skorokhod  map  T  :  D\ 0,  oo)  — >  D[ 0,  oo)  is  explicitly  defined  by 

r(/)(t)  =  f(t)  +  sup  (-/(s))+  for  all  t  >  0.  (4.1) 

Given  a  function  /  in  U[0,oo),  the  pair  (T (/),  sup  (— /(s))+)  is  called  the  “Skorokhod  decompo- 

sS[0,-] 

sition”  of  /  and  this  decomposition  is  unique.  In  (3.8),  we  let 

Xn(t)  =  ~(An(t )  -nt)  +  ^=  (Mvn{An{t))  -  M*{An{t)))  -  -  f  Fn(Vn(s-))dAn(s).  (4.2) 
n  y/n  \  /  n  Jq 

Thus,  by  (3.8)-(4.2),  we  observe  that  ( Vn,In )  is  the  Skorokhod  decomposition  of  the  process  Xn 
and  thus 

Vn{t)  =  T{Xn)(t),  for  all  t  >  0.  (4.3) 

Theorem  4.1.  (Fluid  limit)  For  each  T  >  0, 

||Fn||T=^0  as  n oo.  (4-4) 


Proof.  First  we  show  that 


lim  —j=.  ||4n||r  =  0  a.s., 

n — xxd  yj  fi 


(4.5) 


for  each  T  >  0.  For  the  n-th  system,  we  consider  the  martingale  An(-)  described  in  (3.5).  Using 
a  random  time  change  theorem  for  point  processes  (use  Theorem  T16  in  page  41  of  [8]  with  Ft  = 
a(An(s),  Vn(s)  :  0  <  s  <  t)  and  Lemma  L17  therein  and  the  fact  that  Xn(x)  >  eo  >  0  to  guarantee 
J0°° n\n(yn(s))ds  =  Too  a.s.),  there  is  a  unit  intensity  Poisson  process  Yn(-)  such  that  An{t)  = 
Yn(fg  Xn(Vn(s))ds)  for  all  t  >  0.  Here  Yn{t)  =  (' Yn(nt )  —  nt)/y/n  for  all  n  >  1.  Thus,  using  part 
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(i)  of  Assumption  3.2,  we  have  ||An||r  <  Hh^llcoT  and  we  can  estimate  iP[-^||An||r  >  e]  for  e  >  0 
arbitrary.  Since  Yn  also  is  a  martingale,  using  Doob’s  inequality  we  have 


1  ,, 

■  _ 

p 

—j=  \\An  t  >  e 

_sjn 

<  P 

\\Yn\\c0T  >  ey/n 

Ej^Y/CpT/)} 

HeV™) 


where  </(■)  is  a  non-negative,  convex,  strictly  increasing  function  on  ]R+.  Let  8  >  1/2  be  fixed. 
Then  there  is  a  real  number  xg  >  0  so  that  ex  <  (1  +  x)  +9x2  for  0  <  x  <  xg.  We  pick  any  a  >  0  so 
that  0  <  a  <  xg  and  let  4>(x)  =  eax  for  all  x  >  0.  Then  by  an  elementary  computation,  we  obtain 


E[<f>(\Yn(C0T)\)] 

Oa2C0T  -e^h 

ct>{eVn) 

(See  also  Theorem  5.18,  page  114  of  Chen  and  Yao  [10].)  Consequently,  iP[-^||A„||'r  >  e]  < 

e6a2CoT e~ey/n ^  where  q  >  1/2,  a  >  0  and  Co  >  0  are  constants  independent  of  n.  Now  we  can 
apply  Borel-Cantelli  lemma  to  conclude  the  a.s.  limit  in  (4.5).  Hence,  there  is  no(uj)  €  IN  such 
that  An(T )  <  y/n  for  all  n  >  This  together  with  Assumption  3.2(i)  implies  that 

An(T )  <  y/nAn(T )  +  CqtiT  <  n  +  CquT  <  Kin  for  all  n  >  no(cj), 


for  some  constant  K\  >  0.  Next,  using  (3.1) 


1  A„(T)  Km 

V3  <  -  E  Vj  for  all  n  >  no(< 


3= 1 


n 


3= 1 


But  lim  ’  Vj  exists  a.s.  by  SLLN  and  hence  ||VU|t  <  for  all  n  >  ni(io)  and  for  some 

n— kx)  n  J  1  J 

constant  K-2  >  0.  This,  together  with  Assumption  3.2 (ii) ,  implies  that 

rT 

/  |An(14(s))  —  1 1 (is  <  sup  | An (re)  —  1|T  — ►  0  as  n  — >  oo. 

JO  xG\0,KoT] 


Hence  lim  J0T  |An(Un(s))  —  l|ds  =  0  a.s.  Since 


sup  |Ai(*)  -  *|  < -7=  sup  \An(t)\+  [  |An(Vrn(s))  -  l|ds, 
te[o,T]  vn  te[o,T]  Jo 


using  the  above  fact  with  (4.5),  we  obtain 


lim  sup  | An(t)  —  t\  =  0  a.s. 
n^°°te[o,T] 


(4.6) 


Next,  we  consider  the  martingale  term  —  M/(t)).  Notice  that 

[nT]  2 

E  (M(T))  <  4  H  e(vj  -1)2  <- - ►  0  as  n  ->  oo 

3= 1 

and  similarly  E  ^[M^](T)^  <  — >  oo  as  n  ->  oo.  We  consider  the  vector  valued  martingale 

Mn(f)  =  (M/(t)  /  y/n,  M„  (t)/y/n)  and  define  M*(t)  =  sup  |Mn(s)|  for  all  t  >  0.  Using  Doob’s 

sG[0,t] 
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inequality  once  more,  we  obtain  1E[  sup  |M„,(t)|2]  <  CT/n  where  C  >  0  is  a  generic  constant 

te[o,T] 

independent  of  n.  We  conclude  that 


lim  IE 

n— >oo 


sup  |Mn(f)|2 
te[o,T] 


=  0. 


(4.7) 


Consequently,  (M*  (T))2  =t0asn-+  oo.  This,  together  with  (4.6)  and  the  random  change  of  time 
theorem  (cf.  Section  14,  [7]),  implies  that 


m;(ah(t))  =►  o 

as  n  oo.  Hence,  using  (4.6)  and  (4.8),  we  have 

sup  | An(t)  —  t\  +  M*  (An(T))  — ■>  0  in  probability, 
te[o,T] 

as  n  — >  oo.  Let 


(4.8) 

(4.9) 


Yn(t)  =  Xn(t)  +  -  f  Fn{Vn(s—))dAn{s)  =  ~(An(t)  -  nt)  +  -$=  (  M^An(t ))  -  M«(An(t)) 
n  J o  n  \Jn 


where  Xn  is  described  in  (4.2).  With  (4.9)  in  hand  and  using  (4.2),  we  observe  that 

lim  ||yn||T  =  0  in  probability, 


(4.10) 


(4.11) 


for  each  T  >  0.  By  (4.2),  we  have  Yn(t)  >  Xn(t)  for  all  f  >  0  and  Yn(t )  —  Xn(t)  is  a  non¬ 
negative,  non-decreasing  process  in  D[ 0,  oo).  Therefore,  we  can  use  the  comparison  theorem  for  the 
Skorokhod  map  (Propositions  3.4  and  3.5  of  [9])  to  conclude  that 

0  <  Vn(t)  =  T{Xn){t)  <  T(Yn)(t)  for  all  t  >  0.  (4.12) 

Since  ||T(i^i)||r  £  2||yn||r  by  the  Lipschitz  continuity  of  T,  using  (4.11)-(4.12)  we  can  conclude 

lim  ||yn||T  =  0  in  probability.  (4.13) 

71— XX) 

This  completes  the  proof.  ■ 

Remark  4.2.  In  Theorem  6.4  of  Section  6,  we  are  able  to  show  that  lim  IE  [||V^||r]  =  0  for  some 

n — >00 

m  >  2,  under  an  additional  hypothesis  given  in  (6.6). 


4.2  Diffusion  limits 

Here  we  intend  to  establish  the  weak  convergence  of  the  process  Vn(-)  defined  in  (3.6)  to  a  (reflected) 
diffusion  process.  We  need  to  establish  several  technical  results  to  achieve  this  objective.  Our  first 
proposition  is  an  improvement  of  (4.4).  Using  (3.5)— (3.8),  we  can  describe  the  state  equation  for 
Vn{-)  by 

Vn(t)  +  4=  f  Fn  ( MizA  dAn{s) 

V'«  Jo  V  Vn  / 


—  An(t )  +  M%(An(t))  —  M%(An(f))  +  \fn  J  ( 


Vn(s-) 


n 


-  1  ds  +  y/nln{t),  (4.14) 
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where  In(t )  =  fg  1^>  ^^=0j(s)ds.  Notice  that  ( Vn ,  \fnln )  is  indeed  the  Skorokhod  decomposition  of 

the  process  y/nXn(-)  where  Xn  is  described  in  (4.2).  Then,  T(y/nXn)(t)  =  Vn(t)  for  all  t  >  0  where 
r  is  given  in  (4.1).  We  use  this  fact  in  the  following  proposition. 

Proposition  4.3.  We  have  for  each  T  >  0, 

linr  lim  sup  P 

K—>oc  n— >o o 

Proof.  We  introduce  Xn(t )  =  \/nXn{t )  and 

Zn(t)  =  Xn(t)  +  J*Fn  dAn(s)  +  yftij*  ^  ds 

for  all  t  >  0,  where  Xn  is  defined  in  (4.2)  and  x~  =  —  rninja;,  0}.  Notice  that  {Zn(t)  —  Xn{t)  :  t  >  0} 
is  a  non-negative,  non-decreasing  process  and  thus  by  a  comparison  argument  as  in  (4.12),  we  obtain 
0  <  Vn(t)  <  T(Zn)(t)  for  all  t  >  0.  Consequently,  using  the  Lipschitz  continuity  of  T,  we  get 

||14||r  <  2\\Zn\\T  for  all  T  >  0. 

But  Zn(t)  =  An(t )  +  Mf(An(t ))  -  M%(An(t))  +  s/n /o(An(Pn(s))  -  l)+ds  for  all  t  >  0,  and  hence 
we  have 


I  IK 


n  T 


>  K 


=  0. 


(4.15) 


||K||t<C'i  1 1 An 1 1 t  T  sup  \Mf(An(t))\+  sup  \M%(An(t))\  +  y/n  (An(Vn(s))  -  l)+ds  , 

te[o,T]  te[o,T]  Jo 

(4.16) 

where  C\  >  0  is  a  generic  constant  independent  of  T.  To  estimate  ^[HKIIt  >  K]  f°r  K  >  0,  we 
estimate  the  probability  corresponding  to  each  term  in  the  right  hand  side  of  (4.16).  Throughout, 
we  consider  K  >  0  to  be  a  generic  constant.  First,  we  estimate  lP[||^4n||r  >  K\.  Using  the  same 
technique  used  in  the  proof  of  (4.5),  we  obtain 


IP 


AnWr  >  X 


^  JE\Yn(C0T)\2  ^  CT 
K2  ~  K2  ’ 


where  Co  >  0  is  the  constant  as  in  Assumption  3.2  (i)  and  C  >  0  is  a  generic  constant  independent 
of  K.  Here  Yn(t)  =  ( Yn(nt )  —  nt)/y/n  for  all  t  >  0  and  Yn(-)  is  a  unit  intensity  Poisson  process. 
Hence 

lim  limsup IP  \\An\\T  >  K  =0.  (4-17) 

K—>oo  n — >oc  1 

Next  we  consider  P[  sup  \M%(An(t))\  >  K],  and  here  we  intend  to  use  (4.6).  We  have 
te[o,T] 


p 

sup  \M£(An(t))\  >  K 
te[o,T] 

<  P 

sup  \MZ(An(t))\  >  K,An{T )  <  2 T 
te[o,T] 

<  P 


sup  \M'f(t)\  >  K 

te[0,2T] 


+  P[An(T)  >  2 T] 
+  P[An(T)  >2T], 
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Notice  that  [M%](t)  <  J2j=\(vj~l)2 /n  and  hence  1E([M%](2T))  <  2Ta2,  where  a2  =  ]E(vj  —  l)2  >  0 


is  a  finite  constant.  Thus,  P 


sup  \M%(t)\  >  K 

te[0,2T] 


dent  of  T  and  n.  Hence  linr  lim  sup  IP 

K  >oo  n— >00 

2 T]  =  0.  Thus  we  have 


sup  \M%(t)\  >  K 
te[0,2T] 


<  CT/K2  where  C  >  0  is  a  constant  indepen- 
=  0  and  by  (4.6),  lim  P[An(T )  > 


lim  lim  sup  IP 

K^>oo  n—>oo 


sup  \M£(An(t))\  >  K 
te[o,T] 


=  0. 


(4.18) 


The  proof  of  lim  lim  sup  IP 

K—>oc  n— >oo 


=  0  is  very  similar  to  that  of  (4.18).  For 


sup  \M*(An(t))\>  K\ 
te[o,T] 

the  last  term  in  the  right  hand  side  of  (4.16),  we  intend  to  use  (4.4).  Recall  <5o  >  0  and  M  >  0  are 
as  in  Assumption  3.2(iii).  Then  we  have 


IP 


VA  [  (A n(Vn(s))  -  1  )+ds  >k]  <  [  (A n{Vn{s))  -  1  )+ds  >  K, \\Vn\\T  <  60 

Jo  Jo 


+JP[\\Vn\\T>6o] 

<  IP  [MT  >  K, \\Vn\\T  <50}  +  lP  [HKIIt  >  <5o]  • 


Notice  that  lim  P  [MT  >  K,  ||V^||'r  <  <5o]  =  0  and  by  (4.13)  we  obtain 

A'^oo 


lim  P[\\Vn\\T>So}=0. 


Consequently, 


lim  lim  sup  P 

A— >oo  n— >oo 


fT(Xn(Vn(s))  -  1  )+ds  >  K 
Jo 


=  0 


Now,  (4.16)-(4.19)  imply  (4.15)  and  this  completes  the  proof. 


(4.19) 


Next,  we  introduce 

i 

Rn(i)  =  '^21[Vn(t™-)>d™],  (4.20) 

3= 1 

which  represents  the  number  of  customers  who  abandoned  the  system  among  the  first  i  customers. 
We  also  define  its  fluid-scaled  term 


Rn  (*)  =  -Rn{[nt\)  -  -  1[Vn{tj-)>dj]  (4.21) 

li  It  J  J 

3= 1 

for  all  t  >  0.  We  intend  to  show  Rn{-)  =>  0.  In  the  case  of  constant  intensity,  this  is  indeed  proved 
in  the  Lemma  5.5  of  [26].  But,  our  proof  mainly  uses  the  previous  proposition  and  martingale 
property  of  An. 

Lemma  4.4.  For  each  T  >  0, 

lim  MRJT)]  =  0.  (4.22) 

n— kx 
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Proof.  Consider  the  martingale  {An(t)  :  t  >  0}  and  the  stopping  times  {t?nT 1  :  n  >  1}.  Let  M  >  0 
and  rn  =  ?[„,?]  A  Af.  Then  An(rn)  <  ^4n(tLTi)  =  [nT],  Since  rn  is  a  bounded  stopping  time, 

JE[An(rn )]  =  0.  Thus  0  <  IE  [An{  rn)  —  n  fyn  An(Vn(s— ))ds]  and  using  Assumption  3.2,  we  have 
neoP[Tn\  <  P[An(rn)\  <  [ nT ],  which  implies  P[rn\  <  T/e o.  By  letting  M  f  +oo,  we  have 

m[nT\]  <  CiT,  (4.23) 

where  C\  >  0  is  a  generic  constant.  Next,  we  estimate  1P\  max  Vn (tf—)  >  ATI.  Let  e  >  0  be 

i<i<[nT]  3 

arbitrary.  We  pick  a  large  constant  C2  such  that  0  <  -fX-  <  |.  Then  we  have 


IP 


max  Vn(tf—)  >  K 
1  <j<[nT]  3 


<  IP 

<  P 


1  <  C2TJ  +ip[f^]  >  ^T] 


IIK 


n||C2T 


>  A 


e 

+  4’ 


where  the  second  inequality  follows  from  Chebyshev’s  inequality  and  (4.23).  Also, 


linr  linr  sup  P 

K  >00  n— >00 


\Vr 


n\\C2T  P 


>  K 


=  0 


by  (4.15).  Hence,  there  exists  a  Kq  >  0  such  that  for  all  K  >  Kq,  lirri  sup  IP [ 1 1  Vn \\c2t  >  K]  <  e/4 

n— >00 

and  as  a  consequence  we  have 


linr  sup  P 


max  Vn(fJ—)  >  K 

1  <j<[nT]  3 


<  -  for  all  K  >  Kq. 


To  estimate  P[Rn(T)].  we  pick  K  >  Kq  and  consider  fP[Hn(t”— )  >  dj],  where  j  =  1,2, 
Then  it  follows  that 


(4.24) 

,[nT], 


P[VnW-)><P]  <  P 


<  P 


I< 


Vn(f>-)  >df> 


max  Vnit1} — )  >  K 

1  <j<[nT]  3 


r  „  k  1 

+  p 

dj  <  -= 
\Jn 

+  F„  I  4=  I  . 


By  Assumption  3.3,  linr  Fn ( A- )  =  0  and  consequently,  there  is  a  uq  >  1  such  that 

n— >00  V n 


sup  P\Vn(t™-)  >  dj]  <  e 

1  <j<[nT] 


(4.25) 


for  all  n  >  uq.  Hence  by  (4.21),  E[Rn(T)\  <  /-[ nT]e  <Te  and  we  conclude  that  linr  E[Rn(T) ]  =  0. 

n  n— >00 

This  completes  the  proof.  ■ 

Our  next  step  is  to  show  that  the  term  ^  Iq  Fn  dAn(s )  in  the  state  equation  (4.14) 

can  be  well  approximated  by  fg  H(Vn(s))ds,  where  H(-)  is  given  in  Assumption  3.3. 


Lemma  4.5.  We  have  for  each  T  >  0, 
'Vat*-)' 


sup 

te[o,T] 


n  Jo 


n 


dAn(s )  -  /  H(Vn(s))ds 
Jo 


0  in  probability  as  n  — »  00.  (4.26) 
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Proof.  We  recall  An(t )  =  -An(t)  and  it  satisfies  (4.6).  Hence  we  can  write 


Vn{s-) 


n 


' o 


n 


dAn(s )  -  /  H(Vn(s))ds 


i  o 


=  £  j  (cL4n(S)  -  ds )  +  J*  (  \fnFn  f  Fn(J_  }  )  -  fT(Vn(a))  )  da.  (4.27) 


n 


To  obtain  (4.26),  we  estimate  the  right  hand  side  of  (4.27)  using  (4.6)  and  Assumption  3.3.  First 
we  note  that  {M^(t)  =  An(t )  —  Jq  An(Vn(s))ds  :  t  >  0}  is  a  martingale  and  =  ^An(T). 

By  random  time  change  theorem  of  point  processes  (see  (2.15)  and  the  proof  of  (4.5)), 


1. 


1 


An(T)  =  —Yn  I  n  /  Xn{Vn (a))da  <  -Yn(nC0T), 

n  V  Jo  )  n 

where  Yn  is  a  standard  Poisson  process  and  Co  >  0  is  as  in  Assumption  3.2(i).  Thus,  [M^](T)  < 
\Yn(nC{)T)  and  consequently 

dAn(t)  -  dt  =  dM^(t)  +  (A n(Vn(t))  -  1  )dt 
and  the  first  term  on  the  right  side  of  (4.27)  is  equal  to 


n  I  *  Fn  ( ]  dM*(s)  +  Vn  f  Fn  ( )  (A „(H„(a))  -  l)da. 


io 


n 


i o 


n 


(4.28) 


We  consider  an  arbitrary  5  >  0  and  have 

IP 


sup  y/n 
te[o,T] 


/  0 


f  Fn  (  YalPLI  ]  dM*{t) 


n 


>  5 


n  m 


Fl  ( tnAi  I  d[jgf](s) 


n 


<  T2V[F2n(\\Vn\\T)[M£](T)\  <  ^lE[Fn(\\Vn\\T)[M£}(T)\  <  [Fn(\\Vn\\T)Yn(nC0T)} 

(4.29) 


<  ^  (m^(\\vn\\T)myn(nc0T)})1/2  <  ^  (e[f2(  hv;iit)])1/2 


52 


In  the  above  estimation,  we  have  used  0  <  Fn(x)  <  1  for  all  x,  Cauchy-Schwarz  inequality  and 
the  fact  that  1E[Y2 {tiCqT)\  <  Cfrr'T2  for  some  generic  constant  Ci  >  0  independent  of  n  and  T. 
Next,  we  will  show  -2?[-F^(||V)i||t)]  approaches  0  as  n  — >  oo.  By  Assumption  3.3,  there  exist  no  and 
Mi  >  0  such  that  sup  Fn ( for  all  n  >  n q.  We  consider  n  >  no  and  then 


xS[0,A'] 


JE\F2(\\Vn\\T)]  =  IE 


Fn  (||K 


n  T 


L[ITn||T<^] 


+  IE 


F2n(\\Vr 


n  T 


L[ITn||T>^] 


A/f  2 

<  -^  +  P[V^\\Vn\\T  >  K\. 


Now,  letting  n  — >  oo  and  then  K  — >  oo  and  using  (4.15),  we  obtain  lim  1E[F2 (| | V^Ht)] 

n— >  oo 

Consequently,  by  (4.29),  we  conclude  that 


=  0. 


lim  IP 

sup 

\Jn 

1  dMn(t) 

>  5 

n— xx) 

te[o,T] 

Jo  \  y/n 

(4.30) 
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Similar  to  the  previous  estimation,  we  obtain 

rT 


P 

<  IP 

<  P 


yfr  f  Fn  (Vn(s-))  \\n(Vn(s))  -  1| ds  >  5 
Jo 

^  [  Fn(Vn(s-))\Xn(Vn(s))  -  l\ds  >  5,V^\\Vn\\T  <  I< 
Jo 

Mi  f  |An(KOO)  -  1| ds  >  6 

Jo 


+  P[^/n\\Vn\\T  >  K}. 

-T 


+  P[M\Vu\\t  >  K] 

(4.31) 


In  the  derivation  of  (4.6),  we  have  obtained  linr  L  |An(I4(s))  —  l|ds  =  0  a.s.  This  together  with 

71— XX)  U 

(4.15)  implies  that  the  right  hand  side  of  (4.31)  tends  to  zero  as  n  — >  oo.  This  yields 

rT 


Sn  [  Fn  (14 (s-))  |An(K(s))  "  1| ds  >  6 
Jo 

Consequently,  using  (4.28),  (4.30)  and  (4.32),  we  obtain  for  each  T  >  0 


linr  P 

71— XX) 


=  0. 


linr  P 

sup 

[  \JnFn  (  ^  )  ( dAn(s )  ds) 

>  <5 

Tl^OO 

te[o,T] 

Jo  \  Vn  J 

Finally,  we  intend  to  establish 


linr  P 


sup 


n^°°  |te[o,T] 
5 


\fnFn 


Vn{s-) 


=  0. 


n 


-  H(Vn(s))  ds 


>  5 


=  0. 


(4.32) 


(4.33) 


(4.34) 


Pick  e  >  0  so  that  0  <  e  <  y.  By  Assumption  3.3,  we  take  any  K  >  0  and  then  there  is  a  m  G  IN 

such  that  sup  \s/nFn (-7=)  —  H(x)  \  <  e  for  all  n>n\.  We  consider  n>  n\  and  estimate 
ze[o  ,K]  vn 


P 


<  P 


VnFn 


Vn(s-) 

fn 


-  H(Vn(s)) 


ds  >  6 


VnFn 


Vn  (a-) 


n 


~  H(Vn(s )) 


ds  >  6,  Vn\\Vn\\T  <  K 


+  P[Vn\\Vn\\T  >  K] 


<  P[eT  >  6,  y/n\\Vn\\T  <  K]  +  P[yfd \\Vn\\T  >  K}. 


Since  eT  <  <5,  the  first  term  of  the  above  is  0  for  all  n  >  n\.  Also,  linr  linr  >  K]  =  0. 

K— >00  n— >00 

Hence  (4.34)  follows.  Therefore,  (4.33)  and  (4.34)  yield  (4.26).  This  completes  the  proof.  ■ 

Our  next  lemma  shows  that  the  term  sjn  Jg  ( 1  —  \n(Vn(s) / ^/n))ds  can  be  well  approximated  by 
fg  u(Vn(s))ds,  where  the  function  u(- )  is  as  given  in  Assumption  3.2. 

Lemma  4.6.  We  have  for  each  T  >  0, 


\fn  1  —  A„ 


Vn(s) 


n 


and  consequently, 


sup 

te[o,T] 


\pn  1  —  A^ 


K(s) 


n 


-  u(Vn(s )) 


-  u(Vn(s)) 


ds  — >  0  in  probability  as  n  — >  00, 


(4.35) 


ds 


0  in  probability  as  n  — ►  00.  (4.36) 
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Proof.  Fix  T  >  0.  Let  5  >  0  and  pick  e  >  0  small  so  that  eT  <  5.  Let  K  >  0  be  arbitrary.  By 

Assumption  3.2(iv),  there  is  no  =  no (K)  so  that  sup  \\/n(l  —  An(x/y/n))  —  u(x) \  <  e  whenever 

xe[o  ,K] 


n  >  no-  Thus,  when  n  >  no, 


u{Vn(s )) 


ds  <  eT  <  5 


on  the  set  [||14||t  <  K].  Following  an  estimation  similar  to  that  of  Lemma  4.5,  we  can  have 
lim  sup  IP 

n— xx) 

Hence,  using  (4.15),  desired  conclusion  (4.35)  follows.  ■ 


n  1  —  A 


-  u(Vn(s )) 


ds  >  6 


<  lim  sup  IP [|  |  |  |t  >  K], 


The  following  result  is  an  immediate  consequence  of  Lemmas  4.5  and  4.6.  Therefore,  we  omit  the 
proof. 


Lemma  4.7.  For  all  t  >  0,  let 


en(t)  = 


Vn{s-) 


n 


n 


dAn(s)~  (  H(Vn(s))ds+  f 
Jo  Jo 


n  \  1  —  Ar, 


Vn{s) 


n 


-  u(Vn(s )) 


ds. 


(4.37) 


Then  for  each  T  >  0,  ||e„||T  — ►  0  in  probability  as  n  — >  oo. 


To  discuss  the  weak  convergence  of  the  process  {Vn(t)  :  t  >  0},  we  intend  to  rewrite  the  state 
equation  (4.14)  in  the  following  form: 

Vn(t)  =  £„(*)  -  e„(t)  -  [  u(Vn(s))ds  —  f  H(Vn(s))ds  +  y/nln(t),  (4.38) 

Jo  Jo 


where 

Ut)  =  Mt)  +  Mf(An(t))  -  M*(An(t)), 

and  In(t),  en(t)  are  given  in  (3.8),  (4.37),  respectively. 


(4.39) 


4.3  Generalized  Skorokhod  map  and  weak  convergence 

Following  Section  4  of  [26],  we  introduce  the  generalized  Skorokhod  map.  Its  properties  are  dis¬ 
cussed  in  [26]  and  we  refer  to  them  as  necessary.  Let  p  :  [0,  oo)  — >  1R  be  a  continuously  differentiable 
function  with  p{0)  =  0.  Then  for  a  given  x  in  D[ 0,  oo),  with  x(0)  >  0,  there  exists  a  pair  of  functions 
(z,£)  such  that  z,£  are  also  in  D[0,oo)  and 

(i)  z(t)  =  x(t)  —  fo  p(z(u))du  +  £(t),  z(t )  >  0  for  all  t, 

(ii)  £(■)  is  non-decreasing,  7(0)  =  0,  and  /0°°  z(t)d£(t )  =  0. 

The  condition  p( 0)  =  0  in  [26]  can  be  easily  removed  by  considering  p(t)  —  p( 0)  instead  of  p(-)  and 
then  appropriately  changing  the  input  x(t)  to  x(t)  +p(0)t,  whenever  p( 0)  >  0.  We  use  the  notation 
in  [26]  and  write 

(ct?,'il)p)(x)  =  (z,T).  (4.40) 
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Since  (4.38)  describes  a  Skorokhod  decomposition,  it  is  easy  to  observe  that 

(<^,  V){t,n  -  €n)  =  {Vn,  V^4),  (4-41) 

where  p(x)  =  u(x)  +  H(x )  in  this  case.  Since  both  functions  c/P  and  fjP  are  continuous  on  L>[0,  oo), 
when  the  space  D [0 ,  oo )  is  endowed  with  Skorokhod  Ji-topology  as  in  Proposition  4.1  of  [26],  we 
can  establish  the  following  theorem  for  weak  convergence  of  the  process  (Vn(t))t> o- 

Theorem  4.8.  (Diffusion  limit)  The  process  (Vn,y/nTn)  converges  weakly  to  ( Z,L )  as  n  — >  oo  in 
D®2{ 0,oo),  where  (Z,L)  is  the  unique  solution  to  the  reflected  stochastic  differential  equation 

Z(t)  =  aW(t)  —  [  u(Z(s))ds  —  f  H(Z(s))ds  +  L(t),  (4.42) 

Jo  Jo 

for  all  t  >  0.  Here,  W(-)  is  a  standard  Brownian  motion  and  a  >  0  is  a  constant  which  satisfies 
a2  =  1  +  cr2.  The  functions  u(-)  and  Hf)  are  described  in  the  Assumptions  3.2  and  3.3.  The 
process  Z(-)  is  non-negative  and  has  continuous  sample  paths.  Here,  L(-)  is  the  local-time  process 
of  Z  at  the  origin.  The  process  Lf)  is  continuous,  non- decreasing,  L(0)  =  0  and  satisfies 

Z(s)dL(s)  =  0.  (4.43) 

Proof.  Recall  that  the  process  en(-)  in  (4.41)  converges  to  0  uniformly  on  compact  sets  in  probability 
as  shown  in  Lemma  4.7.  We  intend  to  show  £n(-)  =>•  crW(-)  in  D[ 0,  oo)  in  the  next  proposition  and 
we  assume  this  fact  here.  Here  VP  is  a  standard  one-dinrensional  Brownian  motion.  Our  proof  of 
the  next  proposition  is  based  on  the  martingale  functional  central  limit  theorem.  Hence,  by  the 
continuous  mapping  theorem,  we  can  conclude  —  en  weakly  converges  to  aW.  Therefore,  by  the 
continuity  properties  of  the  mapping  in  (4.41)  (see  Proposition  4.1  in  [26]),  we  have 

(4?,  V)(f,n  ~  en)  as  n  ->  oo. 

Since  the  reflected  SDE  in  (4.42)-(4.43)  has  a  unique  pathwise  solution,  (fP,  ifp)(aW)  =  (Z,  L)  and 
the  proof  of  the  Theorem  4.8  is  complete.  ■ 

It  remains  to  establish  the  weak  convergence  of  the  process  (£n(-))n>i  to  aW(-)  in  D[ 0,  oo).  We 
will  prove  this  in  Proposition  4.10.  We  begin  with  a  technical  lemma  that  will  be  used  in  the  proof. 

Lemma  4.9.  Let  Hn(-)  be  the  process  defined  by 

-i  r  pfn  "i 

Hn(t )  =  ([ nt }  +  1)  -  n  /  Xn{Vn(s))ds  (4.44) 

Vn  l  Jo 

for  all  t  >  0.  Introduce  the  vector-valued  process  { Mn(t )  =  (Hn(t) ,  Mffff) ,  M%(t))  :  t.  >  0},  where 
the  processes  Mf  and  Mf)  are  defined  in  (3.7).  Then  the  following  results  hold: 

(i)  ( Mn(t),IFf )  is  a  mean  zero  martingale,  where  the  filtration  (Pf)  is  defined  in  (3.3). 

(ii)  For  each  t  >  0,  the  quadratic  variation  processes  have  the  following  limits  in  probability: 

(a)  lim  [Hn,Hn\(t)  =  t, 

71— XX) 

(b)  lim  [Mf,Mf\(t)  =  a2t, 

71— XX) 
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(c)  lim  =  0, 

n— >oo 

(d)  lim  [Hn,MZ](t)  =  lim  [Hn,M*](t)  =  lim  =  0. 

n— >oo  n— >oo  n— >oo 

In  part  (b),  <r2  is  groen  by  er2  =  JE(v\  —  l)2. 

Proof.  We  already  know  and  Aff  are  (^fl)-martingales  from  the  discussion  after  (2.4)  and  (2.5). 
To  prove  part  (i),  it  remains  to  show  that  Hn  is  also  an  ( P'f ) - m ar t i ng ale .  Since  Hn{-)  has  piecewise 
constant  paths  with  possible  jumps  at  the  times  we  consider 

Hn{i)  =  —=  (i  +  1)  -  n  /  An 

V™  L  Jo 

for  i  =  0, 1,2, . . ..  Notice  that  Hn(t )  =  //,-,( [nt])  for  all  t  >  0  and  Hn  is  adapted  to  the  filtration 
(PJ1  )i>0  defined  in  (3.2).  We  show  that  (Hn(i),  Pf)  is  a  martingale  and  from  this,  it  follows  that 
(Hn(t) .  Pf)  also  is  a  martingale.  Following  (2.10),  we  introduce  two  filtrations  (Qf)t>o  and  (Gf)t> o 

by 

Gf  =  a(An(s),Vn(s):0<s<t),  g?  =  g?vg$,  for  all  t  >0,  (4.46) 

where  Qf  =  o~((vf,  d'f)  :  i  =  1,2,...).  Here,  Qf  is  the  u-algebra  generated  by  the  sets  in  Qf  U  Gff. 
For  each  i,  the  jump  time  t”  of  the  process  An(-)  is  clearly  a  (£”)-stopping  time  and  lEjf]  is  also 
finite  as  in  (4.23).  Thus  the  filtration  (G?n)i> i  is  well  defined.  Since  An{t)  is  a  (f/”)-martingale  as 
observed  in  (2.13),  we  have 

^n(C+2)l%J  =  ln(C+i)  for  each*  =  0,1,2,....  (4.47) 

Next,  we  observe  that  An{Vf+l)  =  Hn(i)  and  Pf  C  Q?„  for  each  i  =  0, 1,2, . . ..  By  conditioning 

both  sides  of  (4.47)  with  respect  to  Pf.  we  obtain  that  (Hn(i) ,  Pf)  is  a  martingale.  This  completes 
the  proof  of  part  (i) . 

For  part  (ii),  first  notice  that  Hn  can  be  written  as 


for  all  t  >  0,  where  =  0.  Recall  that  using  (2.15),  we  can  write  An(t)  =  Yn( n\n(Vn(s))ds)  for 
all  t  >  0,  where  Yn  is  a  standard  Poisson  process.  Let  (Pj)j>\  be  the  sequence  of  jump  times  of 
Yn  and  define  the  sequence  (r/”)j>i  by  rjf  =  e"  and  r/'j  =  e”  —  e”_1  for  all  j  >  2.  Then  (r/”)  is  an 
i.i.d.  sequence  of  exponential  random  variables  with  parameter  1.  With  the  above  representation, 
/o'7  n\n(yn{s))ds  =  e"  and  hence  Hn  can  be  written  as 


Therefore, 


(4.49) 

(4.50) 
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Let  (t/j)  be  a  generic  i.i.d.  sequence  of  exponential  random  variables  with  parameter  1.  Then  for 
each  e  >  0,  !P[\[Hn,  Hn\(t)  —  t\  <  e]  =  iP[|^  E/=o(l  —  rjj )2  ~  A  <  e]  and  by  strong  law  of  large 
numbers,  linr  ^  —  rb)2  =  t  a.s.  Consequently,  for  each  t  >  0,  lim  [Hn,  Hn](t)  =  t  in 

n— xx  71  J  u  J  n—>oc 

probability. 

Next,  we  consider  Using  (3.7),  we  obtain 


K,K](<)  = 


[nt] 

= 


n 


(vj  ~  l)z 


3= 1 


l[Vu(t;-)<d-  ]• 


Let  Sn(t)  =  \  Ej=i (uj  -  l)2-  Then  |Sn(i)  -  [M£,  M^](f)|  =  \  >T"/|(r,  -  l)2l[y„(t»-)>d™].  Since  v,- 
is  independent  of  U{d™})  and  l[y„  (*?_)><?»]  is  measurable  with  respect  to  this  u-algebra,  we 

have  —  l)2l[u„(tri-)>dri]lCJ(E”-i  U{d™})]  =  0'2l[y„(r-)>d"]-  Taking  the  expected  value  in  both 

sides,  we  have  lE[(vj  -  l)2l[yn(t’?-)>d’?]]  =  ^^[1  [vn(tn-)>dn}\-  Consequently, 


[nt\ 


m Suit)  -  [. K,K\(t)\  =  -f^E  V4u-)><d  =  <T2siE[Rn(t)}, 

ll  J  J 

3= 1 


where  Rn{t )  is  given  in  (4.21).  By  Lemma  4.4,  we  have  lim  JE[Rn(t)\  =  0  and  thus 

n— xx) 

linr  .E|£n(t)  — [M^,M^](t)|  =  0.  On  the  other  hand,  {iu)  is  an  i.i.d.  sequence  with  ]E(vj  —  l)2  =  u2. 

n — xx 

Therefore,  by  strong  law  of  large  numbers,  lim  Sn(t)  =  cr2t  a.s.  Using  these  two  facts,  we  can 

n— xx 

conclude  lim  [ML,  =  aH  in  probability  for  each  t  >  0. 

n— xx 

Using  (3.7),  we  have 


1  ^  _  2 
1=1 


Since  JE(l[yn(tn_)>dn]  I^JLi)  <  1,  we  obtain 

Therefore,  iU([AL,f,  Af?f](t))  <  21E[Rn(t)\,  where  Rn(t )  is  given  in  (4.21).  Using  (4.22),  we  have 
lim  1E([M M.f](t))  =  0  and  thus  lim  [Mf(,  M%\(t)  =  0  in  probability  for  each  t  >  0. 

n— xx  n— xx 

Similar  to  the  above  computations,  we  have 

_  _  1  [nt]  ^ 

[Mn ,  Mn\  (t)  =  ~~  E  (v3  ~  1)1[Vn(q-)<d^]]E(1[Vn^-)>d^]\^jl-l)- 
1=1 


But  Vnifj—)  and  d”  are  measurable  in  U  {d™})  and  Vj  —  1  is  independent  of  U  {d"}). 

Also,  lEjuj  —  1|  <  yJ]E{yj  —  l)2  =  ers.  Hence  we  can  easily  obtain 

E\[M%,  M^](t) |  <  <7s^?[^n(t)]  -»•  0  as  n  -*■  oo 
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by  (4.22).  Thus,  lim  [ML,  -Mffl(f)  =  0  in  probability  for  each  t  >  0. 

n— >oo 

From  (4.48)  and  (3.7),  we  obtain 


[Hn,KKt) 


j  M 

j=i 


xd"] 


nAn(Un(s))ds 


(4.51) 


Let  Yn(t)  =  [Hn,  M£\(t).  We  claim  that  (Y n(t),lFf)  is  a  martingale.  Clearly,  (Yn(t)}  is  adapted 
to  {J~fl)  ■  Using  the  notation  in  (4.49),  we  can  write 


( vj  ~  1)1[l4l(^-)<d"]  n\n(Vn(s))dsj  -  (vj  -  1)(1  -  ^ )l[y„(t^-)<<^]- 

This  term  is  integrable  since  lE(yj  —  l)2  =  a2  <  oo  and  1E(  1  —  r/")2  =  1.  This  term  is  also 
equal  to  y^( Vj  -  1  )l[yn(tn_)<dn](An(t!>+1)  -  An(fj)).  Using  the  fact  that  Vj,Vn(fj—)  and  d™  are 
^-measurable  and  by  (4.47),  we  see  that 


(  r^+i  \ 

IE 

(Vj  -  1)1  y-  -  Jtn  n\n(vn(s))ds J 

r>n 

Qtn 

But  Y7_i  c  g» 
3  1  b 
Consequently, 


and  therefore  by  conditioning  on  1,  we  have  {Yn(f)}  is  an  (^r™)-martingale. 

[nt] 


lE([Yn,Yn](t))  <  IE  [(«,-  -  1  )\An(t]+1)  -  An(t])f 


3= 1 


Since  (An(i),t/™)  is  a  martingale  (recall  (2.13))  and  [4„,  A„](l)  =  lA„(i),  we  have  lE[(An(t™+1)  — 
An(tj  ))2\G™n]  =  A.  Also,  ( Vj  —  1)  is  ^ -measurable,  and  hence 


IE 


(vj  - 1 )\Mt]+1)  -  An(t?)f  \g%\  =  -(vj  - 1) 


Consequently,  JE[(vj  —  l)2(An(i™+1)  —  An(t'j))2]  =  a2/n  and  we  deduce  that 

E([Yn,Yn](t))  <  °~s  ^  — >  0  as  n  — >  oo. 
iw 

Therefore,  Yn(t)  =  [Hn,  MLl(t)  — >  0  in  probability.  The  proof  of  lim  [iLn,  M,f](t)  — >  0  in  probability 

n— xx) 

is  similar  to  that  of  the  previous  result  and  therefore  we  omit  it.  This  completes  the  proof  of  part 
(ii)  of  lemma.  ■ 

Proposition  4.10.  Let  f n  be  defined  by  (4.39).  Then  the  process  £n(-)  converges  weakly  to  crW(-) 
in  D[0,oo)  as  n  — >  oo,  where  W(-)  is  a  standard  Brownian  motion  and  a  >  0  is  a  constant  given 
by  a2  =  1  +  a 2.  Here,  a2  =  1E(ui  —  l)2  is  a  constant  as  in  Assumption  3.1. 

Proof.  We  consider  the  vector-valued  process  {(An(t) ,  M%(An(t)) ,  M%(An(t)))  :  t  >  0},  where 
An(t)  =  \An(t)  for  all  t  >  0.  We  intend  to  show  that  this  process  converges  weakly  to  ( W\ ,  oy IT 2 , 0) 
in  H®3[0,oo),  where  lUi  and  W2  are  independent  standard  Brownian  motions.  If  we  can  write 
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An(t)  =  Hn(  An(t))  for  some  process  Hn  and  if  we  can  establish  the  weak  convergence  of  (Hn,  M%,  M%) 
to  ( IV i ,  as W2 ,  0),  then  we  can  use  the  almost  sure  limit  of  An(t)  in  (4.6)  together  with  the  random 
time  change  theorem  (cf.  Section  14  of  [7])  to  obtain  the  desired  conclusion.  Unfortunately,  the 
representation  An{t)  =  Hn(An(t))  for  all  f  >  0  is  not  possible,  and  we  need  some  adjustments  to 
this  idea  in  our  proof.  Another  point  is  that  An  is  a  martingale  with  respect  to  (Gt)  as  well  as 
(Gt)  hltrations  defined  in  (4.46),  while  AL))  and  are  martingales  with  respect  to  (J~t)  hltration 
in  (3.3). 

To  overcome  those  difficulties,  we  observe  two  facts.  First,  consider  process  Hn  defined  in  (4.44). 
Then 

Hn(An(t ))  =  An{t'J,+l)  if  <  t  <  (4.52) 

Second,  the  vector-valued  process  Mn(f)  =  (Hn(t),  M^(t))  for  t  >  0  is  an  (jF")-martingale 

by  part  (i)  of  Lemma  4.9.  Our  approach  here  is  to  use  the  martingale  functional  central  limit 
theorem  (cf.  Theorem  1.4,  Chapter  7  in  [13]  or  Theorem  2.1  in  [34])  to  establish  the  weak  con¬ 
vergence  of  Mn  to  (VFi,  crslL2,  0)  and  then  to  apply  random  time  change  theorem  (cf.  Section  14 
of  [7])  to  conclude  Mn(An(f))  also  converges  to  (Wi,  <rsW2, 0).  Finally,  we  establish  that  for  each 

T  >  0,  sup  \An(t)  —  H(An(t))\  converges  to  zero  in  probability.  Then  as  a  consequence  of  this, 
t£[  0,T] 

( An(-),M%(An(-)),M%(An( •)))  converges  weakly  to  (Wu  asW2, 0)  in  D®3[ 0,oo). 

To  implement  the  sketch  of  the  proof  given  above,  we  consider  the  vector-valued  martingale 
(M n{t),J-™)  and  apply  the  martingale  FCLT,  Theorem  1.4  of  Chapter  7  in  [13].  We  intend  to  verify 
the  assumption  in  the  quoted  Theorem  1.4,  part  a).  First,  we  show  that  for  each  T  >  0, 


lim  IE  sup  |M„(f)  —  Mn(t— )|  =  0. 

n  >00  \te[0,T]  J 


Using  the  representation  (4.49)  for  Hn,  we  can  write 

1 


IE 


sup  \Hn(t)  -  Hn(t—) 
te[o,T] 


=  IE 


max  1  —  n”  < 
n  1  <j<nT  J  1 


—IE  [  max  |1  —  n"-]2 
n  \i <j<nT  J 


1/2 


where  (r/'j)  is  an  i.i.d.  sequence  of  random  variables  with  exp(l)  distribution.  If  (?/j)  is  a  generic 
i.i.d.  sequence  of  exp(l)  random  variables,  then  -1E(  max  |1  —  =  -1E{  max  |1  —  77 •  | 2 )  and 

H  ’  in  4  <j<nT'  h'  >  n  V1  <j<nT[  'A  ’ 

since  1E(  1  —  rjj)2  =  1,  by  (Al)  (see  the  Appendix),  we  have 

1  /  „  2\ 
lim  —IE  max  1  —  u  ,•  r  =  0. 

n— >oo  n  \1  <j<nT  J  J 

Hence  lim  ]E[  sup  \Hn{t)  —  Hn(t— )|]  =  0.  Similarly, 

,wo°  te[o,T] 


IE 


sup  \M%(t)  -  M%(t-)\ 

te[o,T] 


<  IE 


(  1 

—=  max 
V  \fn  1 <j<nT 


< 


n 


[  max 
y 1 <j <n 7 


Since  (vj)  is  i.i.d.  and  JE{vj  —  l)2  =  <r2  <  00,  again  by  (Al),  lim  lnJE(  rnax^ | v3  —  1|2)  =  0. 

In  part  (ii)  of  Lemma  4.9,  we  have  established  lim  [AL*,  M?U(t)  =  djt  in  probability  for  1  < 

n— >00  J 

i,j  <3  where  [AL?(,  Mr(]  represents  the  th  quadratic-covariation  process  of  the  martingale  Mn 
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(see  Remark  1.5  in  page  340  of  [13])  and  the  constant  matrix  C  =  (cy) 3x3  is  described  by  the 
diagonal  matrix  C  =  diag(l,  a2,  0).  Hence,  the  assumptions  of  the  martingale  FCLT,  Theorem  1.4, 
part  a)  in  pages  339-340  of  [13]  are  satisfied.  Thus,  we  can  conclude  that  Mn  converges  weakly  to 
( W[ ,  a s W 2 , 0)  as  n  — >  00,  where  W\  and  W2  are  independent  standard  Brownian  motions.  By  (4.6), 

sup  | An(t)  —  t\  — >  0  as  n  - >00  for  each  T  >  0,  and  hence  by  the  random  time  change  theorem 
te[o,T] 

(Section  14,  [7]),  Mn  o  An  also  converges  weakly  to  {W\,  CT.5IT2, 0)  in  D®3[ 0, 00)  as  n  — >  00. 

Now,  to  establish  the  weak  convergence  of  the  process  ( An(t ),  M%(An(t)) ,  M%(An(t)))  it  remains 

to  estimate  sup  | Hn(An(t))  —  An(t)\  for  each  T  >  0.  Let  e  >  0.  Notice  that 
te[o,T] 


sup 

Hn(An(t ))  -  An(t) 

>  e 

<  P 

sup 

Hn(An(t ))  -  An(t) 

>  e,  An(T)  <  2 T 

te[o,T] 

te[o,T] 

+P  [. An{T )  >  2 T]  .  (4.53) 

On  the  set  [An(T)  <  2 T],  using  (4.52),  we  have 


sup 

te[o,T] 


Hn(An(t ))  -  An(t) 


sup  sup 
0<j<[2nT\  t?<t<q+ 1 


An(t) 


But  using  the  i.i.d.  sequence  of  exp(l)  random  variables  (7/")  introduced  in  the  discussion  above 
(4.49),  we  have 


sup 

%<*<%+ 1 


3+ 1 


^4n(^j+i)  —  An(t )  <  — f=  ^4"/  n\n(Vn(s))ds  I  —  — r=(l  + 


Therefore, 
IP 


sup 

Hn(An(t ))  -  An(t) 

>  e,An(T )  <  2 T 

te[o,T] 

<  P 


=  P 


n 


sup  -r=(l  +  7#+1)  >  e 
0<j<[2nT]  Vn 

sup  -^=(1  +  rjj+i)  >  e 
0<j<[2nT]  Vn 


(4.54) 


where  (rjj)  is  a  generic  sequence  of  i.i.d.  exp(l)  random  variables.  Since  P(1  +  ijj+1)2  <  00,  by 
(Al)  (see  the  Appendix), 


lim  —E 

n— kx)  77, 


sup  (1  +  Vj+i)2 

0<j<[2nT\ 


=  0. 


Hence,  the  right  hand  side  of  (4.54)  tends  to  zero  and  consequently,  the  first  term  on  the  right  side 
of  (4.53)  converges  to  zero  as  n  tends  to  infinity.  On  the  other  hand,  An(T )  converges  to  T  almost 
surely,  and  hence  the  second  term  on  the  right  side  of  (4.53)  also  converges  to  zero  as  n  —>  00. 
Using  these  two  limits  in  (4.53),  we  obtain 


lim  P 

sup 

Hn(An(t))  -  An(t) 

>  e 

n — >00 

te[o,T] 

for  each  T  >  0. 


We  can  combine  this  result  with  the  already  established  weak  convergence  of 
(Hn(An(t)),M%(An(t)),M%(An(t)))  to  (Wi,  asW2, 0)  as  n  — *  00  to  obtain  that  the  process 
(An(t) ,  M%(An(t)) ,  M^(An(t)))  converges  weakly  to  {W\,  crsW2, 0)  in  L>®3[ 0,oo)  as  n  — ►  00.  There¬ 
fore,  the  process  £n(')  defined  in  (4.39)  converges  weakly  to  a W{-)  in  D[0,oo)  as  n  ->  00,  where 
W (•)  is  a  standard  one- dimensional  Brownian  motion  and  a2  =  l+cr^ .  This  completes  the  proof.  ■ 
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5  Scaled  Queue  Length 


Here  we  establish  an  asymptotic  relationship  between  the  queue-length  and  offered  waiting  time 
processes  under  heavy  traffic  conditions.  We  essentially  follow  the  proof  of  this  fact  in  Reed  and 
Ward  [26]  (Theorem  6.1)  and  supplement  it  with  necessary  estimates  to  accommodate  our  general 
assumptions.  For  a  conventional  GI/GI/ 1  queue,  this  fact  was  established  in  Theorem  4  of  Section 
3  in  Reiman  [27].  We  circumvent  the  use  of  Reiman’s  “Snap-shot  Principle”  and  a  comparison 
result  with  a  non-abandoning  queue  used  in  Reed  and  Ward  [26]  by  obtaining  different  estimates. 

For  t  >  0,  let  Qn(t)  be  the  queue  length  of  the  n-th  system  at  time  t  and  Qn{t)  =  be  the 
diffusion-scaled  queue  length.  Following  the  notation  in  [26],  we  also  introduce  the  random  variable 

an(t)  =  the  arrival  time  of  the  customer  in  service  at  time  t  in  the  n-th  system. 

If  the  server  is  idle  at  time  t,  we  let  an{t )  =  t. 

Theorem  5.1.  Let  Qn  and  Vn  be  scaled  queue-length  and  scaled  offered  waiting  time  processes, 
respectively.  Then  as  n  — >  oo, 

Qn  —  Vn=>0 

in  D[ 0,  oo). 

To  prove  this  theorem,  we  follow  the  discussion  in  page  21  of  [26]  with  appropriate  changes  and 
then  establish  two  lemmas.  Recall  that  for  the  j- th  arrival  in  the  n-th  system,  service  time  is  Vj/n. 
First,  notice  that  Vn(an(t)-)  <t-  an(t)  <  Vn (an(t)~)  +  ^WUan(t))  and  hence 

Vn{an{t)~)  <  Vn(t  -  an(t ))  <  Vn(an(t)~)  +  -^vAn(an(t))  (5-1) 


for  all  t  >  0.  For  T  >  0,  let  un[T )  =  maxjn,-  :  1  <  j  <  An(T)}.  Then  we  observe  that  for  each 
T  >  0,  un(T)/y/n  =t  0  as  n  ->  oo.  Indeed,  for  an  arbitrary  e  >  0, 


IP 


— ~un{T )  >  e 
yn 


<  IP 


un(T )  >  e,  An(T)  <  TT 


+  dP[An(T)  >  2T], 


We  know  from  (4.6)  that  lim  lP[An(T)  >  2 T]  =  0.  Also,  note  that 

oo 


"2 

1 

—j=un(T)  >  e,  An(T)  <  2T 
\Jn 

<  P 

max  Vn  >  e 
sjn  \<j<2nT 

and  lim  IP 

n— >  oo 

Thus,  we  have 


-k=  max  Vn  >  e 
Vn  l<j<2nT  J 


=  0  follows  from  (Al)  in  the  Appendix  or  Lemma  3.3  of  [18]. 


lim  IP 

71— XX) 


~v=un(T)  >  e 


n 


=  0. 


(5.2) 


Notice  that  for  n  >  1  and  0  <  t  <  T,  we  have  0  <  VAn(an(t))  —  un(T)  and  this  together  with  (5.2) 
implies  that 


sup  \Vn(t  -  an(t))  -  Vn(an(t)-)\  =>  0 
te[o,T] 

as  n  oo.  Dividing  by  y/n,  and  using  Theorem  4.1,  we  deduce  that 


sup  (t  —  an(t ))  =>■  0  (5.3) 

te[o,T] 
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as  n  — >  oo. 

The  next  two  technical  lemmas  enable  us  to  prove  Theorem  5.1  and  we  use  the  above  facts  in 
their  proofs.  Our  Lemma  5.2  corresponds  to  Lemma  6.1  of  [26]  but  the  proof  requires  a  different 
estimate  to  accommodate  our  general  assumptions. 


Lemma  5.2.  For  each  T  >  0, 


sup 

te[o,T] 


n 


An(t ) 

£ 

j=A„(a„(t )) 


L[U(t" 


)>d?]  =►  0 


as  n 


oo. 


Proof.  We  begin  with  the  following  identity:  for  t  >  0 

^  An(t)  An(t) 

~T  E  1  [VM-)>d7]  =  M^An(t))-M^An(anm  +  -r  E  Fn{Vn{i'] -)) ,  (5.4) 

a/  77<  J  J  -»  /  tt, 

j=An(an(t))  j=An(an(t)) 

where  M^(t)  is  described  in  (3.7)  (see  also  (2.6)).  By  Proposition  4.10,  0  as  n  — *  oo  and 

by  (4.6),  sup  \An{t)  —  t\  — >  0  as  n  — >  oo.  Using  these  facts  together  with  (5.3)  and  then  applying 
te[o,T] 

random-time  change  theorem  in  [7],  we  can  conclude 

—  M%  o  Ano  an(-)  =s>  0  (5.5) 


in  D[0,oo)  as  n  — ►  oo.  Next,  we  show 

1  An  (  *) 

7/^  E  FniVnitfj  -))  =*>  0 

j=A„(an(-)) 

as  n  — >  oo  and  hence  by  (5.4)  this  will  imply  the  stated  result.  For  t  >  0,  let 

An(t) 

Wn(t)  =  —=  SUp  Y]  Fn{Vn{fj-)) 

and  e,  e  >  0  be  arbitrary.  Choose  K  >  0  large  enough  then,  by  (4.24),  there  is  no  £  iV  so  that 


IP 


max  Vjift1} — )  >  K 

l<j<[nT]  J 


<  e 


for  all  n  >  no-  Using  the  fact  that  -Fn(-)  is  non-decreasing,  we  obtain 


P[Wn(T)>e\  <  IP 

<  P 


Wn(T)  >  e,  max  Vn(F-)  <  K 

1  <j<[nT]  J 


+  e 


1 


n 


K 


sup  {An(t)  -  An(an(t)))  >  e 


n  J  te[o,T] 


+  C 


(5.6) 


for  all  n  >  uq.  We  take  <5i  >  0.  Then  by  the  Assumption  3.3,  there  is  n\  6  IN  such  that 
yfrFn(%)  <  H(K )  +  <5i  for  all  n  >  n\.  We  let  the  constant  C\  =  H(I\)  +  ch  >  0.  Then  for  all 
n  >  max{no,ni},  A^Fn(K / ^/n)  <  C\/n  and  thus 


1  /  K  \ 

e  " 

p 

—j=Fn  —j=  sup  (An(t)  -  An(an(t)))  >  e 
vn  \vn/  te[o,T] 

<  P 

sup  (An(t)  -  An(an(t)))  >  — 
te[o,T]  Li 
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But  since  an(t)  <  t,  we  have 


2  sup  \An(t)-t\+  sup  \t  —  an(t)\  >  sup  [An(t)  -  An(an(t))\. 
te[o,T]  te[o,T]  te[o,T] 


Hence  by  (4.6)  and  (5.3),  it  follows  that 


lim  IP 

71— XX) 


1 


n 


K 


—j=Fn\  —j=  sup  {An(t)  -  An(an(t )))  >  e 


=  0 


,nJ  te[o,T] 

and  using  this  in  (5.6),  we  have  lim  lP[Wn(T)  >  e]  =  0.  Using  this  together  with  (5.5)  in  the 

n— >  oo 

identity  (5.4),  we  obtain  the  desired  conclusion.  ■ 

Lemma  5.3.  Let  T  >  0.  As  n  — >  oo, 


n  sup 


f 

- 1 

'  an  (t) 

V  ^  J 

ds  =>•  0. 


(5.8) 


Proof.  Let  e  >  0  be  arbitrary.  We  pick  K  >  0  large  enough  then,  by  (4.15),  there  is  no  G  IV  so 
that 

lP[\\Vn\\T  >  K]  <  e/2 

for  all  n  >  uq.  Let  6  >  0.  Using  part  (iv)  of  Assumption  3.2,  there  is  n\  €  IN  so  that 

\fn  sup  \\{x/y/n)  —  1|  <  max  u(x)  +  5  for  all  n  >  n\.  We  let  C  =  max  u(x)  +  6  >  0 
x£[0,K]  x£[0,K] 

and  for  n  >  1,  introduce  Wn{T)  =  sjn  sup  fa  (t)  Xn 

ie[o,T]  ’ 


Vn(s) 

yjn 


- 1 


x£[0,K] 
ds.  Then,  we  have 


lP[Wn{T)  >  e]  <  JP\Wn{T)  >  e,  HKHt  <  K 

<  IP  |  C  sup  (t  —  an(t))  >  e 
te[o  ,T] 


+ 


e 

+  2’ 


for  all  n  >  max{no,ni}.  Using  this  together  with  (5.3),  we  obtain  lim  JP[Wn(T)  >  e]  =  0  and  this 

n— xx 

yields  (5.8).  ■ 

Next,  we  use  Lemmas  5.2  and  5.3  to  prove  Theorem  5.1. 

Proof  of  Theorem  5.1.  We  begin  with  the  estimate 

An(t) 

An(t)  —  An(an(t ))  —  1  [Vn(tn-)>dn]  <  Qn(t)  <  An(t )  —  An(an(t))  +  1 

j=A‘n  (^)) 

as  explained  in  the  proof  of  Theorem  6.1  in  [26].  For  n  >  1  and  t  >  0,  let 


yn(t)  =  An(t )  -  An(an(t))  +  \fn  /  An 

J  an  (t) 


Vn{s) 


n 


ds, 


where  An(-)  is  described  in  (3.5).  Then, 

An(t) 


•Tn(l)  /—  ^2  )>d"]  ^  Qn(t)  <  yn(t)  +  r- 

V  j=An(an(t))  V 
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for  all  t  >  0.  Hence  we  can  write 


j  An  (t) 

y n{t) - -j=  ^  l[vn(tn-)>dn]  —  Vn(an(t))  +  [Vn(an(t))  —  Vn(t)] 

j=An(a„(t )) 

<  Qn(i)  -  K(0  <  ^n(i)  +  —j=~  Vn(an(t ))  +  [Un(an(t))  -  Vn{t)}. 

y/n 

Next,  we  introduce  Znf)  by 

Zn{t)  =  An(t)  -  An(an(t ))  +  yfn  [  Xn  ( )  _  l  ds, 

Jan(t)  \  Vn  J 

for  all  t  >  0.  Then  we  can  employ  the  estimates  for  Vn(an(t))  in  (5.1)  and  obtain, 

j  An(t) 

Zn(t)  —  —j=  'y  ^  )>d"]  T  [Vra(ara(^))  —  bn(^)] 

77-  3  3 

j=An(an  (t)) 

<  Qn(t )  -  K(f)  <  Zn(t)  +  ^V4„(an(t))  +  [Un(an(t))  -  Un(i)]  + 

Consequently, 

^  An  (t) 

I Qn(t)  ~  Vn(t)\  <  \Zn(t)\  H - ~j=  ^  1  [y„(t"_)>dn] 

j=A„(an  (t)) 

+|Un(an(t))  -  V^(i)|  +  —7=vAn{an{t))  +  —/=■  (5-9) 

Y  77-  Y  77- 

Since  An  =>  fUi  as  ro  — >  oo,  and  by  (5.3),  we  have  |An(-)  —  An  o  an(-)|  =t  0  as  ji  ->  oo.  We  use 
this  fact  together  with  Lemma  5.3  to  conclude  \Zn{-)\  =A  0  as  n  — >  oo.  Similarly,  Vn(  )  converges 
weakly  as  in  Theorem  4.8.  This  together  with  (5.3)  yields  \Vn  o  anf)  —  Vnf)\  0  as  n  — >  oo. 
Finally,  notice  that  0  <  ^vAn(an(t))  —  >  where  un(T)  is  as  in  (5.2),  and  hence  by  (5.2),  we 

deduce  that  v a„(o„(-)) / V™  0  as  n  — >  oo.  Using  all  these  facts  in  (5.9),  we  are  able  to  conclude 
Qn(')  ~  Vn(-)  =>  0  as  n  — >  oo.  This  completes  the  proof.  ■ 

As  a  consequence  of  Theorem  4.8,  we  have  the  following  corollary. 

Corollary  5.4.  The  scaled  queue-length  process  {Qn(t))t>  o  a  Iso  converges  weakly  as  n  — ►  oo  to  the 
diffusion  process  (Z(t))t> o  of  (4.42)  in  D[0,oo). 


6  Convergence  of  Cost  Functionals 

6.1  Introduction 

Here  we  introduce  an  infinite  horizon  discounted  cost  functional  associated  with  the  n-th  system 
described  in  (3.8) .  Our  goal  is  to  show  that  the  expected  value  of  this  cost  functional  converges  to  the 
expected  value  of  the  same  cost  functional  associated  with  the  limiting  diffusion  process  described 
in  (4.42).  For  heavy  traffic  limits  related  to  scaled  queue-length  processes,  such  convergence  of  cost 
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functionals  are  obtained  in  [5,  32,  19]  and  they  are  very  useful  in  controlled  queueing  systems  to 
obtain  an  asymptotically  optimal  arrival  rate  An(-).  First  we  introduce  the  scaled  idle  time  process 
Ln(-)  associated  with  (3.8)  by 

Ln(t )  =  \fnln(t )  for  all  t  >  0.  (6.1) 


Then,  after  scaling  we  can  rewrite  (3.8)  as 


Vn(t)  +  ^=  f  Fn[^J-)dAn(s)  =  An{t)  +  Mvn{An{t))-M*{An{t ))  (6.2) 

V"  Jo  \  V™  J 

+V^  f 

Jo 

for  all  t  >  0. 

Let  7  >  0  be  a  discount  factor  and  C(-)  be  a  running  cost  function  of  polynomial  growth.  For 
the  n-th  system  described  in  (6.2),  we  introduce  two  types  of  costs:  A  cost  of  /0°°  e~li:C{Vn{t))dt 
related  to  the  waiting  times  and  an  idleness  cost  proportional  to  J0°°  e~7tdLre(t).  Thus  the  infinite 
horizon  discounted  cost  functional  associated  with  the  n-th  system  is  given  by 


x  (Vn(s)) 

An  1  f — 

1  - 1 

v  vs  ) 

ds  Ln(t ) , 


J(Vn,  Ln)  =  IE  e-7*  C(Vn(t))dt  +  p  ■  dLn(t) 


(6.3) 


where  p  >  0  and  7  >  0  are  fixed  constants.  The  cost  functional  related  to  the  limiting  diffusion  in 
(4.42)  is  given  by 

/*oo 


J(Z,  L)  =  ]E  e“7*  [C{Z(t))dt  +  p  ■  dL(t)\ .  (6.4) 

Jo 

Under  our  assumptions,  we  intend  to  show  that  these  cost  functionals  in  (6.3)  and  (6.4)  are  finite. 
Our  main  result  here  is  the  convergence  of  J(Vn,  Ln )  to  J(Z,  L )  as  n  tends  to  infinity. 


6.2  Assumptions  and  the  convergence  of  the  cost  functionals 

We  need  to  make  further  assumptions  in  this  section.  We  assume  that  the  running  cost  function 
C(  )  can  have  polynomial  growth  and  the  service  times  (uj)  have  higher  moments.  We  also  need  to 
strengthen  the  part  (iii)  of  Assumption  3.2.  All  these  assumptions  will  be  used  in  the  proof  of  main 
theorem  (Theorem  6.2)  here,  but  Theorem  6.4,  which  is  of  independent  interest  remains  valid  only 
with  the  assumption  (6.6)  below.  We  will  make  it  clear  in  the  statements  of  these  results.  Next, 
we  list  the  additional  assumptions  below: 

(a)  There  are  constant  K\  >  0  and  integer  £  >  1  such  that 

0  <  C( x)  <  Ki{l  +  xe),  for  all  x  >  0.  (6.5) 

Here  C(-)  is  the  running  cost  function  in  (6.3). 

(b)  The  sequence  of  service  times  (17)  described  in  Section  3  satisfies 

E[vf1+e)]  <  00  for  some  integer  m  >  max  {A  2},  and  small  e  >  0.  (6.6) 

(c)  The  arrival  sequence  of  intensity  functions  (An(-))  satisfies  the  following  two  conditions: 
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(i)  There  exist  two  constants  So  >  0  and  M  >  0  such  that 

sup  sup  \/n\Xn(x)  —  1|  <  M.  (6.7) 

ri>  1  a;S[0,<5o] 

(ii)  There  exist  two  constants  A  >  0  and  B  >  0  such  that 

sup  y/n(\n(x)  —  1)+  <  A  +  Bx  for  all  x  >  0.  (6.8) 

n>  1 

(d)  We  also  assume  that  the  sequence  of  (Fn)  of  distribution  function  of  abandonments  satisfies 

0  <  \fnFn  —  C\x(l  +  xr ),  for  all  x  >  0,  (6.9) 

where  C\  >  0  is  a  generic  constant  independent  of  n  and  the  constant  r  >  0  satisfies 

2 (r  +  1)  <  m. 

Since  \/n(l  —  A n(x/y/n))  converges  to  a  non-negative  function  u(x)  for  all  x  >  0  (Assumption  3.2, 
part  (iv)),  conditions  (6.7)  and  (6.8)  are  not  very  restrictive.  (See  also  the  examples  in  Remark 
3.4.)  Assumptions  (6.6)  and  (6.9)  will  be  used  in  obtaining  some  uniform  integrability  estimates 
for  the  integrand  in  the  cost  functional  J(Vn,Ln). 

Remark  6.1.  The  assumption  (6.9)  indeed  imposes  some  restrictions  on  the  Assumption  3.3  of 
Section  3.  Here  we  follow  up  on  the  changes  required  in  the  examples  (Fn)  provided  in  Remark  3.f. 

(a)  Let  Fn  =  F  for  all  n,  and  assume  F  is  differentiable  with  a  derivative  of  polynomial  growth 
satisfying 

sup  F'(y)  <  C{  1  +  xr)  with  0  <  r  <  m  —  1, 

y£[0,x] 

where  F\y )  denotes  a  derivative  of  F  at  y.  Then  (Fn)  satisfies  Assumption  3.3  as  well  as 
(6.9). 

(b)  Take  Fn(x)  =  1  —  exp(—  h(^/nu)du)  for  x  >  0  and  assume  that  h  is  a  continuous  function 
with  polynomial  growth  satisfying  sup  h(y)  <  C(  1  +  xr)  with  0  <  r  <  m  —  1.  This  sequence 

3/S[  0,x] 

(Fn)  also  satisfies  Assumption  3.3  as  well  as  (6.9). 

(c)  For  a  general  sequence  ( Fn ),  assume  that  Ff{-^)  converges  to  a  non-negative  function  h(x) 
uniformly  on  compact  sets  and  Ff(-j^)  <  C(1  +  xr),  where  C  >  0  is  a  constant  independent 
of  n.  Then,  ( Fn )  satisfies  Assumption  3.3  as  well  as  (6.9). 

Our  main  theorem  in  this  section  is  the  following: 

Theorem  6.2.  In  addition  to  the  basic  assumptions  in  Section  3,  assume  (6.5) -(6.9)  to  hold.  Then 
the  cost  functionals  J(Vn,Ln)  and  J(Z,L)  are  all  finite  and 

lim  J(Vn,Ln)  =  J(Z,L).  (6.10) 

n— kx) 

Proof  of  this  theorem  needs  several  preliminary  results.  Using  Theorem  4.8,  together  with  Sko- 
rokhod’s  representation  theorem,  we  can  simply  assume  that  lim  (Vn(t),  Ln(t))  =  (Z(t),  L(t))  for 

n— >oo 

all  t  >  0,  a.s.  To  obtain  the  convergence  of  cost  functionals,  we  need  to  obtain  a  polynomial  growth 
bound  which  is  independent  of  n  for  the  expected  value  of  the  integrand  in  J(Vn,Ln). 
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Lemma  6.3.  Assume  (6.6)  in  addition  to  the  basic  assumptions  in  Section  3.  Let  £„(•)  be  the 
process  described  in  (4.39).  Then, 

^[IIUIt]  <a2(i  +  t™/2),  (6.11) 

where  K2  >  0  is  a  generic  constant  independent  of  n. 

Proof.  In  (4.39),  we  let  £n(f)  =  An{t)  +  Mf(An(t))  —  Alf[{An{t))  for  all  t  >  0.  First,  we  estimate 
IE [ 1 1  An \\tp].  By  (2.15),  An  has  the  representation  An(t)  =  Yn(n  Xn(Vn(s))ds)  for  all  t  >  0,  where 
Yn  is  a  standard  Poisson  process.  We  introduce  the  Poisson  martingale  Yn(t )  =  ](Yn(nt)  — 
nt)  and  then  we  can  write  An(t )  =  Yn(f*  Xn(Vn(s))ds)  as  in  (2.15).  Moreover,  for  any  integer 
k  >  1,  1 1 An 1 1 j?  <  where  the  constant  Co  >  0  is  as  in  Assumption  3.2.  Consequently, 

JE[\\An\\f]  <  lE[\\Yn\\2^oT}. 

The  quadratic  variation  process  of  the  martingale  Yn  is  given  by  [Yn,Yn](t)  =  yYn(nt )  and 
therefore,  using  Burkholder’s  inequality  (cf.  [24])  we  obtain  iZT [ 1 1 IIcotI  <  ^dE[Yn(nC0T)k}  where 
Ck  >  0  is  a  constant  depending  only  on  k.  Recall  that  if  A  is  a  Poisson  random  variable  with 
parameter  A  >  0,  then  for  any  integer  j  >  1,  JE[X(X  —  1)  •  •  •  (A  —  (j  —  1))]  =  AT  Consequently, 
JE(Xi)  =  pj( A),  where  pj{x )  is  a  degree  j  polynomial  of  the  form  pj(x)  =  x J'  +  Cj-ix^ 1  +  •  •  •  +  c\x 
and  the  constants  ci,  C2, . . . ,  Cj-i  may  depend  on  j.  Since  Yn(nCoT)  is  a  Poisson  random  variable 
with  parameter  nC^T  >  0,  we  can  easily  obtain  the  bound  \ JE[Yn(nCoT)k]  <  C±pk{T),  where 
C\  >  0  is  a  constant  and  Pk(x)  is  a  polynomial  of  degree  k.  The  constant  C\  >  0  and  the  polynomial 
Pk(-)  can  be  chosen  independent  of  n  and  they  may  depend  on  k.  Using  these  estimates  and  letting 
T  >  1,  we  have 

mUnWf]  <  C2pk(T)  <  Ck(l  +  Tk), 

where  C2  >  0  and  Ck  >  0  are  generic  constants  independent  of  n.  Consequently,  using  Holder’s 
inequality, 

m\Anm  <  Km(l  +  Tm/2),  (6.12) 

where  Km  >  0  is  a  constant  independent  of  n.  Since  An(T )  <  (y/nAn(T)  +  uCqT),  we  can  easily 
use  the  above  estimate  to  obtain 

lE[{An(T))k}  <  Cknk(l  +  Tk )  for  each  k  >  1,  (6.13) 

where  Ck  >  0  is  a  generic  constant  independent  of  n  and  T. 

Next,  we  intend  to  estimate  1E[  sup  \M^(An(t))\m].  Consider  the  filtration  {tF?)j> i  introduced 

te[o,T] 

in  (3.2).  Let  T  >  0  be  fixed.  Then  An{T )  is  a  stopping  time  with  respect  to  this  filtration  (A")j> i, 
since  [ An(T )  =  k]  =  [Vf  <  T  <  ff+1]  G  T'f.  We  introduce  a  sequence  of  random  variables  related 
to  the  n-th  system  by 

1  j 

Sj  =  —=  ^(vi  -  l)l[yn (*?-)«£*]  and  S0  =  0.  (6.14) 

Vn  i= l 

We  suppress  the  dependence  of  Sj  on  n  for  simplicity  of  the  presentation.  Following  an  argument 
similar  to  the  establishment  of  martingale  property  of  Mv(n)  in  (2.4),  we  observe  that  (*Sj)j>i  is  a 
martingale  with  respect  to  the  filtration  (JF")j>i .  Next,  observe  that 

sup  \Mf(An(t))\m  =  sup  |Sj|m.  (6.15) 

te[o,T]  j<An(T ) 
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Hence,  we  can  use  the  fact  that  An(T )  is  an  (JFn)-stoppirig  time  to  estimate  E[  sup  |5j|m]. 

j<An(T) 

We  intend  to  use  Rosenthal’s  inequality  for  square  integrable  martingales  (see,  e.g.,  [28]).  First 
notice  that  the  predictable  quadratic  variation  process  of  (Sj)  satisfies  (Sj)  <  a2j /n.  Using  Rosen¬ 
thal’s  inequality  (Theorem  1  in  Section  2  of  [28]  with  p  =  m  and  the  stopping  time  S  =  An(T ) 
therein),  we  obtain 


E 


SUp  \Sj\m\  <  Cn 
j<A„(T) 


a 


m/2 


n 


E  (Hn(T)-/2)  +  E  ((AS)^(t) 


(6.16) 


where  Cm  >  0  is  a  constant  depending  only  on  m  and  (A S)%  =  sups<t  IAS's].  It  is  easy  to  observe 
that 

m  i  (  \ 


E  ((AsrA,m)m  < 


E  sup  |  Vj  —  1] 


nm/2  \j<An(T) 
2 


Using  (6.13)  and  the  fact  that  [E  ( An(T)m /2)  <  E[An(T)m],  we  have 


a  m 

jpn/ 2 


E  (y4„(T)m/2)  <  Ci(l  +  Tm/2), 


(6.17) 


where  C\  >  0  is  a  constant  independent  of  n  and  T.  To  estimate  the  second  term  in  (6.16),  we  let 
K  >  2  be  a  constant  independent  of  n  and  T,  and  we  pick  the  precise  value  of  K  later.  We  consider 

E  (  SUp  | Vj  -  l|m  )  <  E  (  SUp  | Vj  -  l\m  )  +  E  I  SUp  | Vj  -  l\ml[An(T)>KnT]  )  •  (6.18) 

\j<A„(T)  J  \j<KnT  )  \j<An(T)  J 

Using  (A2)  and  the  estimates  there  in  the  Appendix,  E(swpj<KnT  \vj  —  l|m)  <  C^nT,  where  C2  >  0 
is  a  constant  independent  of  n  and  T.  Since  m  >  2,  we  have 


m/2 


n 


E  sup  | ^  -  l|m  <  CoT. 

\i<KnT  I 


(6.19) 


Next,  we  consider  J  =  E  ^sup^^^  | Vj  —  l\ml[An(T)>KnT]  j  •  From  (2.15),  it  follows  that  An(T )  < 
Yn(nCoT)  where  Co  >  0  is  the  constant  in  Assumption  3.2  part  (i)  and  Yn  is  a  standard  Poisson 
process.  Hence 

j  <  'Y!  E\  sup  I  Vj  -  l|ml  [Yn(nC0T)=k]  ■ 

k>KnT  \-7-fc  / 

Now  we  let  p  =  (1  +  e)  and  q  =  1  +  \  so  that  I  +  |  =  1,  where  e  >  0  is  as  in  (6.6).  Then  by  Holder’s 
inequality, 

/  \  1  i/(i+e) 


^  E 

k>KnT  L 


E  sup|m -l|m(1+e) 


J<k 


■  [ P[Yn(nC0T )  =  k]]e/(1+e) . 


Using  (6.6)  together  with  (Al)  and  (A2)  in  the  Appendix,  we  have  E  (supJ<fc  \vj  —  lpU+<9)  <  C^k, 
where  C3  >  0  is  a  generic  constant  independent  of  n  and  T.  Furthermore,  P[Yn(nCoT)  =  k]  — 
e -nC0T  (?}Cop_ '  pjsjng  these  two  estimates  and  by  a  simple  algebraic  manipulation,  we  derive 


J  <  C4(nCoT)£/{1+e)e-nCoTe/(1+e)  k 


k=I<nT 


( (nC0T) 
^  kl 


k\  e/(!+e) 


31 


where  C4  >  0  is  a  generic  constant  independent  of  n  and  T.  Next,  we  use  the  fact  that  log (k\)lA  > 
^(klogk  —  k )  where  q  =  1  +  ^  and  thus  (kl)e^1+€^  >  To  simplify  the  notation,  we  also 

introduce  the  function  g(x)  =  xflqe~xlq  for  all  x  >  0.  Notice  that  g  is  positive,  continuous,  and 
linia^oo g(x)  =  0.  Thus,  g(-)  is  bounded  and  0  <  g{x)  <  M,  where  M  =  g{  1).  Then  we  obtain 


OO 

J  <  C'4M  k 

k=KnT 


Now,  we  choose  the  constant  K  >  0  so  that  Then  we  have 

OO 

J  <  C4M  k 

k= 0 

and  all  the  constants  on  the  right  hand  side  are  independent  of  n  and  T.  Therefore,  combining 
(6.16)-(6.20),  we  obtain  the  estimate 


2  <0° 


(6.20) 


E 


sup  |5j|m 
j<An(T) 


<Cm[l+Tm/\ 


where  Cm  >  0  is  a  constant  independent  of  n  and  T. 


Thus,  we  have 


E 


sup  \Mx(An(t))\m 

te[o,T] 


<Km(l+Tm/2), 


(6.21) 


where  Krn  >  0  is  a  generic  constant  independent  of  n  and  T.  A  very  similar  computation  for 

E[  sup  \M%(An(t))\m]  yields 
te[o,T] 


E 


sup  \M^An(t))\m 

te[o,T] 


<  Km(  1  +  Tm/2), 


(6.22) 


where  Km  >  0  is  a  generic  constant  independent  of  n  and  T.  Combining  (6.12),  (6.21)  and  (6.22), 
desired  conclusion  (6.8)  follows.  ■ 


Next,  we  prove  the  following  theorem  which  is  of  independent  interest  and  it  complements 
Theorem  4.1  and  Proposition  4.3. 

Theorem  6.4.  In  addition  to  the  basic  assumptions  in  Section  3,  assume  (6.6)  to  hold.  Then 

lim  E[\\Vn\\y]  =0,  (6.23) 

n— >00 


where  m  >  2  is  given  in  (6.6). 

Proof.  Let  the  processes  Xn  and  Yn  be  described  by  (4.2)  and  (4.10),  respectively.  Then  using 
(4.12)  and  the  Lipschitz  continuity  of  the  Skorokhod  map  T  in  (4.1),  we  have 

0<  ||Vrn||T<2||yn||T.  (6.24) 
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But  using  (4.2),  (4.37)  and  a  simple  algebraic  manipulation,  we  can  write  Yn(t)  =  -4=£n(t)  + 

V  ^ 


fo  [^(Vn(s)  /  y/n)  ~  f°r  >  0.  Thus  we  have 


£7(111*)  <  Cn 


nm/2 


e(II6.IIt)  +  ® 


A.f^l-1 


n 


ds 


(6.25) 


where  Cm  >  0  is  a  constant  independent  of  n  and  T.  Also,  notice  that 


IE 


n 


ds  I  <  Tm~1lE 


n 


ds 


<  T 


im—1 


E 


A„  ( tkhl  |  -  i 


n 


dsli 


-<K] 


+  IE 


Xn  ^1-1 


n 


ds  1 


[||V„||T>Jf] 


where  AT  >  0  is  a  constant.  Hence  using  part  (i)  of  Assumption  3.2,  we  have 


IE 


(r 

Xn  ( *<!>)  -  1 

m  \ 

ds  )  <  Tm 

sup  |An(z)  -  1|  +  (Co  +  l)mfP[||Un||T  >  K] 

\J  0 

V  J 

J 

x£l[0,K] 

(6.26) 


The  first  term  in  the  right  hand  side  of  (6.26)  tends  to  zero  as  n  — >  oo,  by  part  (ii)  of  Assumption 
3.2,  and  the  second  term  also  tends  to  zero  as  n  — ■>  oo  by  Theorem  4.1.  Using  this  together  with 
(6.11)  in  (6.25),  yields  lim  1U(||1)),||21)  =  0.  Then  we  can  use  (6.24)  to  reach  the  desired  conclusion 

(6.23).  This  completes  the  proof.  ■ 

Remark  6.5.  If  dE{yj+e)  <  oo  for  some  e  >  0  then  lim  _/E(||Y)J|2d  =  0  holds. 

1  n— >oo 

Lemma  6.6.  In  addition  to  the  basic  assumptions  in  Section  3,  assume  (6.5) -(6.8)  to  hold.  Then 


sup  IE  (  [T  ( An  ( -  1  |  ds)  <  Km(  1  +  T2m). 


(6.27) 


n>l  \  Jo  \  \  Yn  ,  7  7 

Here  Krn  >  0  is  a  constant  independent  of  n  and  T. 

Proof.  Assuming  (6.8),  we  obtain 

(  An  f  ^  )  -  1  ]  ds)  <  TmIE(A  +  B\\Vn\\T)m  <  CmTm[l  +  lE(\\Vn\\y)\,  (6.28) 


n 


where  Cm  >  0  is  a  constant  independent  of  n  and  T.  The  constants  A  >  0  and  B  >  0  are  as  in 
(6.8).  Next,  by  (6.24),  -2£||V^||jl  <  2mlE\ \Yn\ \™.  Then,  we  can  employ  (6.25)  together  with  (6.11) 
to  obtain  lU||yn||™  <  Km[  1  +  Tm/2  +  Tm ],  where  Km  >  0  is  a  generic  constant  independent  of  n 
and  T.  Combining  these  facts  with  (6.28),  the  desired  result  follows.  ■ 

Proposition  6.7.  Under  the  assumptions  of  Theorem  6.2, 

IE\\Vn\\y<Km[l  +  T2m},  (6.29) 

where  Km  >  0  is  a  constant  independent  of  n  and  T. 
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Proof.  Let  the  process  Zn  be  as  in  the  proof  of  Proposition  4.3.  Then  ||U„||t  <  2||Zn||'r  for  all 
T  >  0  as  explained  there.  Moreover,  Zn(t)  =  £n(t)  +  \Jn  Jq  (An(14(s)/\/n)  —  1  )+ds  for  all  t  >  0, 
where  is  as  in  Lemma  6.3.  Consequently, 

mZnWx  <  Cm  (EUn\\^  +  nV^j\uVn(s)/Vn)  ~  l)+ds]m)  , 

where  Cm  >  0  is  a  generic  constant  independent  of  n  and  T.  Using  this  estimate,  (6.11),  (6.27), 
and  the  fact  that  lU||Un||™  <  2mlE\\Zn\\j; ,  we  obtain  (6.29).  ■ 

Remark  6.8.  The  above  proposition  strengthens  the  result  in  Theorem  6.f.  The  estimate  (6.29) 
implies  that  JE||Un||™  <  I\m{  1  +  T2m)/(^n)m. 

In  the  following  proposition,  we  obtain  uniform  L2-estimates  for  Jq  Fn(Vn(s—) / y/n)dAn(s) 
and  for  yjn  /QT  |A n{Vn{s)/yJn)  -  l|ds. 

Proposition  6.9.  Under  the  assumptions  of  Theorem  6.2,  the  followings  hold: 

(i)  IE  /0T  Fn(Vn{s-)/y/fi)dAn{s)] 2  <  Ci(l  +  J’2(m+1))  and 

(ii)  IE  [v^/0T  |A n{Vn{s)/Jn)  ~  1| ds\2  <  C2(l  +  T2(m+1)). 

As  a  consequence, 

lE{Ln(T))2  <  C3(l  +  T2(m+1)),  (6.30) 

where  Ln  is  as  in  (6.1).  Here  C\ ,  C2 ,  C3  G  (0,  oo)  are  generic  constants  independent  of  n  and  T. 

Proof.  Notice  that  0  <  JQT Fn(Vn(s~)  /  y/n)dAn(s)  <  A=Fn(\\Vn\\T/y/n)An(T).  Using  this  to¬ 
gether  with  (6.9),  we  have 

0<  4=  fT Fn(Vn(s-)/V^)dAn(s)  <ClAn(T)(\\Vn\\T  +  \\Vn\\r+1), 

Vn  Jo 

where  C±  >  0  is  a  constant  independent  of  n  and  T.  Consequently, 

fT  Fn(^f)dAn(s)\  <C2lE\An(T)2(  IIKII^+IIKII^)!  ,  (6-31) 

Vn  Jo  \  Vn  J  \  1 

where  C2  >  0  is  a  constant  independent  of  n  and  T.  Using  Holder’s  inequality,  we  obtain 

r  -  1  2/m  r  _  .-i(m—2)/m 

lE[An(T)2 \\Vn\\2T]  <  [lE||Un||??]  [jE(An(T)J2m^m~ 2) 

_|_  rji2m/ (m—2)  ^  (m—2)/m 

<  K2{  1  +  T4)(l  +  T2)  <  K3{  1  +  T6),  (6.32) 

where  the  second  inequality  follows  from  (6.29)  and  (6.13).  Here  K,  >  0  (i  =  1,2,3)  are  constants 
independent  of  n  and  T.  Next  we  estimate  the  term  fE'[Hr),(T)2||Un||^ f+1^].  By  (6.9),  2(r  +  1)  <  m 
and  we  take  p  =  >  1  and  Q  =  \-\/p  >  1  •  Thus  2  +  1  =  1.  Then 

]E  An(T)2 ||U„||r(r+1)  <  JE\\Vn\\ip  1/P  [lEAn(T)2g}1/g  <  K1(l  +  T2m)1/p{l  +  T2q)1/q 

<  K2{  1  +  T2m)(l  +  T2)  <  K3{  1  +  r2(m+1)),  (6.33) 
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where  the  second  inequality  follows  from  (6.29),  (6.13),  and  Ki  >  0  (i  =  1,2,3)  are  constants 
independent  of  n  and  T.  Since  m  >  2,  by  combining  (6.31)-(6.33)  we  obtain  part  (i). 

For  part  (ii),  notice  that 


r  rT  i 

2  i-T 

IE 

\fn  /  |A n(Vn{s)/y/n)  -  l|ds 
Jo 

<  TIE 

Jo 

Vn\Xn(Vn(s) / yfn)  -  1| 

(6.34) 


By  (6.7),  we  have 


IE 


[Vn\X  n{Vn(s)/y/n) 


<  M2T , 


(6.35) 


where  M  >  0  is  a  constant  independent  of  n  and  T  as  given  in  (6.7).  Also,  since  |An(x)  — 1|  <  Co  +  1 
where  Co  is  as  in  Assumption  3.2,  we  obtain 


IE 


[Vn\Xn{Vn{s)/y/n)  -  l|]2dsl[||yii||T>5o] 


<  (Co  +  l)2TnJP[\\Vn\\T  >  5o] 

z  ^  i  \2r~r  n  mVn\W) 

<  (C0  +  l)r— — - — - ,  (6.36) 


n 


W2 


where  (6.36)  is  from  Chebychev’s  inequality.  Since  m  >  2,  <  1  and  by  (6.29),  the  left  side  of 

(6.36)  is  bounded  above  by  Co(l+T2m)  for  some  constant  Co  >  0.  Thus  by  combining  (6.34)-(6.36), 
we  establish  part  (ii). 

For  (6.30),  using  (6.1)  and  (6.2),  we  notice  that 


Ln(T) 


Vn(T)  + 


ds, 


(6.37) 


where  £n(-)  is  described  in  (4.39).  From  (6.11),  (6.29)  and  Jensen’s  inequality,  we  have 

mUT)\2}  <  (m\Cn\\T])2/m  <  Ki{l  +  T™/2)2/™  <  R\(  1  +  T)  and, 

]E[\Vn(T)\2}  <  m\Vn\m)2/m  <  K2(l  +  T2m)2/m  <  K2(l  +  r2). 


Notice  that  rn  >  2,  K\  =  2K\,K2  =  2K-2  and  these  constants  are  independent  of  n  and  T.  Now 
using  these  two  estimates  together  with  parts  (i)  and  (ii)  of  this  proposition  in  (6.37),  we  obtain 
(6.30).  ■ 


With  all  these  preliminary  results  in  hand,  now  we  are  able  to  prove  Theorem  6.2. 

Proof  of  Theorem  6.2.  First  we  consider  the  cost  functional  J(Vn,Ln )  in  (6.3).  With  the  poly¬ 
nomial  bound  (6.30)  in  hand,  using  integration  by  parts,  it  can  be  easily  verified  that 
fF[/0°°  e~l1:dLn(t)]  =  'ylElf^0  e~7t Ln(t)dt].  Therefore,  we  have  the  representation 

/»oo 

J(vn,  Ln)  =  E  e~^[C(Vn(t))  +  7 pLn{t)]dt.  (6.38) 

Jo 

Since  (Vn,Ln)  — >  ( Z,L )  a.s.  as  n  — ►  oo,  using  (6.30)  together  with  Fatou’s  lemma,  we  obtain 

1E[L(T )2]  <  C3(  1  +  T2(m+1)),  (6.39) 
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where  C3  >  0  is  a  constant  as  in  (6.30).  Hence,  using  integration  by  parts  again,  we  can  also  write 
J(Z,L )  described  in  (6.4)  as 

pOO 

J{Z,  L)  =  E  e~lt[C(Z(t))  +  7 pL(t)}dt.  (6.40) 

Jo 

Let  us  consider  the  term  E[J^°  e~"/tC(Vn(t))dt\  in  (6.38).  Let  p  be  the  probability  measure  on 
the  Borel  u-algebra  B  of  [0,  00),  defined  by  p(B)  =  7  fB  e~ltdt  for  each  Borel  set  B.  Consider  the 
probability  measure  p  ®  IP  on  the  space  [0, 00)  x  H  equipped  with  the  product  a- algebra  B  <g>  T ’, 
where  (H,  P ,  P)  is  our  probability  space.  Then  using  Fubini’s  theorem,  we  have 


P^®ip[C(Vn)\  =  jlE 


e~^C(yn(t))dt 


(6.41) 


Since  Vn(t)  — >  Z(t)  for  all  t  >  0  a.s.,  we  have  C(Vn(t))  converges  to  C(Z)  almost  surely  in  p  ®  P 
as  n  — »  00.  Next,  we  show  the  uniform  integrability  of  (C(Vn)).  Let  m  >  2  be  as  in  (6.6).  Using 
the  assumptions  (6.5),  (6.6)  and  the  simple  inequality  0  <  (1  +  xr )  <  2(1  +  x)r  <  2r(l  +  xr)  for 
r  =  y  >  1  and  x  >  0,  we  obtain 


sup  [{C{Vn) )r]  <  l'K\  sup  P 

n> 1  n> 1 


poo 

/  e-^(l  +  (u„(t))m)dt 

Jo 


<  rfK2 


e-7t(l  +  <  ^ 


where  the  second  inequality  follows  from  (6.29).  The  constants  K \ ,  K2  >  0  are  independent  of  n. 
Hence 


P^p[C{Vn)]  <  00  for  all  n  >  1,  and  Ym^P^&IP[C(Vn)]  =  P^]p{C(Z)\. 

Indeed,  E^ip[C(Z)\  is  finite  and  bounded  above  by  7/I2  /0°°  e_7t(l  +  t2m)dt.  Hence 

poo  poo 

lim  7  /  e-7tC(Un(t))df  =  7 IE  /  e^C^^dt.  (6.42) 

Jo  Jo 

In  a  similar  manner,  we  can  establish  uniform  integrability  of  (Ln)  by  using  (6.30), 


sup  P^®]p[(Ln)2]  =  7  sup  P 

ri> 1  n>l 


e~^(Ln(t))2)dt 


pOO 

<  C37  /  e_7*(l  +  f2(m+1))df  <  00, 

Jo 


where  C3  >  0  is  a  constant  independent  of  n  as  in  (6.30).  Hence,  using  Theorem  4.8,  we  can 
conclude 

e~ 7t(l  +  t2(m+1))di  <  OO. 

This  yields 

poo  poo 

lim  E  e~ltLn{t)dt  =  E  /  e"7iL(f)dt.  (6.43) 

jo  Jo 

Since  7  >  0  and  p  >  0  are  constants  in  (6.38)  and  (6.40),  it  immediately  follows  that  J(Vn,Ln ) 
converges  to  J(Z,L)  as  n  — »  00.  This  completes  the  proof  of  Theorem  6.2.  ■ 

Remark  6.10.  If  the  cost  functional  J(Vn,Ln)  does  not  deal  with  the  idle  time  costs,  that  is  if 
p  =  0,  then  we  do  not  need  the  assumptions  (6.7)  and  (6.9).  In  that  case,  Proposition  6.9  also  is 
not  necessary  and  the  estimate  (6.29)  is  sufficient,  to  obtain  Theorem  6.2  with  p  =  0. 


lim  P^]p\Ln\  =  lE^i p[L\  and  IE^]p{L\  <  C37 
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Appendix 


The  following  lemma  was  used  in  the  proofs  of  Proposition  4.10  and  Lemma  6.3.  We  include  it  for 
completeness. 


Lemma  6.11.  Let  T  >  0  be  fixed.  Consider  a  sequence  of  non-negative  i.i.d. 
(. Xn )  with  lE(Xn )  <  oo.  Then 


lim  —IE  max  X1 

n— >oo  n  ll<j<{nT] 


=  0. 


random  variables 

(Al) 


Proof.  Without  loss  of  generality,  we  can  simply  take  T  >  2.  Let  G  be  the  distribution  function  of 
Xn  and  introduce  u  =  sup{x  >  0  :  G(x)  <  1}.  Notice  that  0  <  u  <  +oo.  Since  (Xn)  is  i.i.d.,  we 
have  1P\  max  Xj  <  x]  =  GY(x')In71  and  therefore, 

1  <j<[nT] 


IE 


max  Xj 

1  <j<[nT] 


(1  -G{x)[nT])dx 


[U  [ U[nT]G(y)W-1dG(y)dx  =  [nT }  C  yG{yt^-ldG{y), 
JO  J  x  Jo 


by  using  Fubini’s  theorem.  Consequently, 


0  <  —IE 
n 


max  Xj 
1  <j<[nT] 


<  T  f yGWW-'dGiy)  <  T  f ydG(y). 

Jo  Jo 


(A2) 


Since  [nT]  >  2,  0  <  yG(y)^nT^  1  <  y  for  all  y  >  0  and  lim  yG(y)^nT^  1  =  0  for  0  <  y  <  u.  On 

n^>  oo 

the  other  hand,  JQU ydG(y)  <  oo  since  JE(Xn)  <  oo.  Therefore,  by  the  dominated  convergence 
theorem,  we  conclude  lim  fnu yG(y)^nT^1dG(y)  =  0.  Hence,  using  this  in  (A2)  we  obtain  the 
desired  conclusion  (Al).  This  completes  the  proof.  ■ 
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